-- Logs begin at Tue 2022-05-17 17:25:04 UTC, end at Tue 2022-05-17 18:34:22 UTC. -- May 17 18:03:42.837355 dv-cinder-841302-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 18:03:42.845894 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 18:03:42 2022] *** May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: nodename: dv-cinder-841302-3-iscsi May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: machine: x86_64 May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: clock source: unix May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: pcre jit disabled May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: detected number of CPU cores: 4 May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: current working directory: / May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: detected binary path: /usr/bin/uwsgi-core May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: your processes number limit is 47680 May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: your memory page size is 4096 bytes May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: detected max file descriptor number: 2048 May 17 18:03:42.848829 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: lock engine: pthread robust mutexes May 17 18:03:42.849799 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: thunder lock: enabled May 17 18:03:42.849799 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 18:03:42.849799 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 18:03:42.893747 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: Python main interpreter initialized at 0x55a250bf39c0 May 17 18:03:42.893747 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: python threads support enabled May 17 18:03:42.893747 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: your server socket listen backlog is limited to 100 connections May 17 18:03:42.893747 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: your mercy for graceful operations on workers is 90 seconds May 17 18:03:42.894118 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: mapped 403077 bytes (393 KB) for 2 cores May 17 18:03:42.894196 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: *** Operational MODE: preforking *** May 17 18:03:42.894407 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: *** uWSGI is running in multiple interpreter mode *** May 17 18:03:42.894407 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: spawned uWSGI master process (pid: 102642) May 17 18:03:42.894625 dv-cinder-841302-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 18:03:42.895181 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: spawned uWSGI worker 1 (pid: 102643, cores: 1) May 17 18:03:42.895532 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: spawned uWSGI worker 2 (pid: 102644, cores: 1) May 17 18:03:42.896026 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 18:03:44.092946 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 18:03:44.098334 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 18:03:44.821460 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:03:44.821460 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: from cryptography.utils import int_from_bytes May 17 18:03:44.822444 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:03:44.822444 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: from cryptography.utils import int_from_bytes May 17 18:03:44.824785 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:03:44.824785 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: from cryptography.utils import int_from_bytes May 17 18:03:44.825114 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:03:44.825114 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: from cryptography.utils import int_from_bytes May 17 18:03:47.410279 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 18:03:47.410917 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 18:03:47.411072 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 18:03:47.411441 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 18:03:47.411697 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 18:03:47.412094 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.412245 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 18:03:47.412638 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.412732 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 18:03:47.412824 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.412996 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 18:03:47.413092 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.413356 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.413449 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 18:03:47.413614 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 18:03:47.413711 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.413977 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.414148 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.414303 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.414400 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.414656 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.414762 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.414921 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.415025 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.415237 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.415328 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.415563 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-3-iscsi {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.415667 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.415889 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.415986 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.416201 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.416322 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.416543 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.416653 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.416833 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.416926 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.417155 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.417247 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.417475 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.417572 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-3-iscsi {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.417784 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.417883 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.418100 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.418287 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.418407 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.418757 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.418873 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.419066 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.419163 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.419383 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.419487 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.419693 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.419791 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.420026 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.420206 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.420340 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.420525 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.420649 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.420835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.420962 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.421151 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.421289 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.421491 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.421583 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.421809 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.421985 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-3-iscsi {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.422122 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.422315 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.422448 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.422643 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.422762 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.422954 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.423090 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.423372 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.423465 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.423687 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.423789 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-3-iscsi {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.424000 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.424107 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.424331 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.424427 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.424656 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.424748 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.424967 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.425102 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.425295 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.425420 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.425617 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.425734 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.425937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.426063 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.426258 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.426395 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.426563 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.426718 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.426894 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.427054 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.427204 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.427379 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.427524 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.427703 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.427833 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.428026 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.428141 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.428334 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.428421 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.428647 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.428757 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.428959 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.429051 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.429283 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.429380 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.429593 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.429688 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.429843 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.429940 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.430095 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.430202 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.430416 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.430510 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.430762 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.430851 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.431074 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.431167 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.431381 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.431475 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.431648 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.431740 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.431903 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.431998 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.432789 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.432877 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.433097 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.433257 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.433574 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.433672 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.433885 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.433972 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.434198 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.434281 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.434514 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.434635 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.434855 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.434951 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.435162 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.435246 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.435470 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.435565 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.435782 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.435875 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.436106 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.436199 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.436410 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.436505 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.436748 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.436833 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.437061 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.437156 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.437368 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.437453 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.437687 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.438023 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.438262 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.438349 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.438585 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.438674 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.438898 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.438993 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.439207 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.439293 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.439529 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.439621 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.439853 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.439938 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.440158 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.440302 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.440393 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.440473 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.440697 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.440784 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.441001 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.441169 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.441322 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.441407 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.441626 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.441710 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.441934 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.442032 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.442224 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.442309 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.442527 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.442666 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.442857 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.442954 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.443163 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.443249 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.443471 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.443563 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.443776 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.443861 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.444079 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.444163 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.444380 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.444462 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.444685 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.444769 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.444989 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.445080 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.445290 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.445381 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.445596 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.445681 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.445905 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.445997 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.446209 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.446293 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.446515 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.446626 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.446851 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.446936 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.447158 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.447249 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.447479 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.447565 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.448367 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.448519 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.448690 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.448776 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.449065 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.449165 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.449377 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.449480 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.449683 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.449773 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.450003 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.450102 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.450311 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.450396 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.450637 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.450726 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.450961 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.451048 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.451265 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.451351 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.451570 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.451662 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.451886 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.451981 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.452193 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.452285 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.452496 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.452589 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.452804 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.452895 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.453104 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.453188 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.453404 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.453497 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.453711 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.453807 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.454016 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.454109 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.454319 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.454417 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.454648 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.454747 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.454958 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.455054 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.455267 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.455354 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.455575 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.455667 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.455879 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.455966 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.456184 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.456270 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.456485 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.456576 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.456813 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.456908 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.457137 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.457223 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.457448 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.457534 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.457759 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.457856 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.458068 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.458162 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.458389 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:03:47.458483 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.458740 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.458843 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.459056 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.459142 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.459371 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.459457 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.459698 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.459794 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.460011 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.460098 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.460324 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.460410 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.460636 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.460729 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.460954 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.461038 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.461268 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.461351 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.461596 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.461687 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.461910 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.461995 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.462224 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.462334 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.462541 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.462769 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.462878 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.462970 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.463195 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.463291 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.463660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.463763 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.464001 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.464100 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.464307 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.464392 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.464630 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.464723 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.464946 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.465043 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.465265 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.465401 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.465598 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.465686 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.465924 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.466016 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.466240 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.466332 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.466591 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.466691 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.466913 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.467004 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.467241 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.467328 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.467570 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.467655 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.467883 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.467966 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.468202 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.468299 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.468516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.468602 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.468831 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.468930 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.469145 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.469247 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.469458 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.469544 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.469771 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.469856 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.470092 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.470186 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.470409 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.470495 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.470751 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.470847 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.471065 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.471159 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.471381 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.471474 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.471694 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.471791 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.472007 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.472094 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.472324 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.472411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.472633 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.472727 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.472943 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.473029 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.473252 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.473346 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.473566 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.473652 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.473869 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.473963 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.474185 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.474280 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.474498 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.474634 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.474836 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.474927 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.475147 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.475250 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.475465 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.475553 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.475774 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.475862 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.476088 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.476173 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.476403 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.476503 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.476715 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.476800 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.477031 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.477119 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.477345 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.477445 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.477654 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.477740 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.477966 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.478050 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.478282 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.478376 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.478603 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.478692 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.479441 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.479538 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.479776 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.479891 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.480067 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.480154 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.480382 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.480465 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.480698 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.480787 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.481004 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.481097 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.481316 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.481410 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.481630 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.481716 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.481940 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.482038 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.482257 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.482343 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.482597 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.482687 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.482902 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.483069 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.483218 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.483305 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.483535 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.483623 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.483859 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.483943 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.484174 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.484282 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.484489 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.484575 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.484792 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.484877 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.485110 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.485205 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.485416 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.485502 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.485725 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.485810 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.486034 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.486129 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.486347 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.486440 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.486676 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.486765 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.486988 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.487091 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.487297 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.487382 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.487600 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.487682 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.487905 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.487990 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.488218 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.488303 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.488526 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.488621 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.488830 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.488968 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.489134 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.489228 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.489435 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.489520 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.489739 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.489824 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.490065 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.490153 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.490378 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.490463 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.490712 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.490857 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.491020 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.491106 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.491326 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.491420 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.491666 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.491759 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.491970 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.492063 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.492288 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.492451 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.492605 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.492700 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.492919 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.493013 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.493233 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.493332 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.493554 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.493641 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.493868 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.493961 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.494181 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.494274 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.494491 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.494589 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.494902 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.494990 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.495217 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.495303 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.495537 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.495633 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.495846 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.495931 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.496165 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.496251 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.496483 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.496570 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.496813 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.496909 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.497133 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.497219 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.497455 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.497547 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.497764 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.497848 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.498077 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.498169 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.498390 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.498483 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.498729 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.498835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.499046 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.499140 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.499361 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.499446 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.499684 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.499778 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.499997 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.500094 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.500308 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.500404 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.500619 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.500713 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.500929 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.501022 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.501243 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.501327 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.501560 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.501652 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.501863 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.501947 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.502178 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.502305 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.502491 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.502604 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.502842 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.502927 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.503155 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.503249 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.503469 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.503554 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.503775 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.503859 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.504091 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.504176 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.504405 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.504492 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.504717 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.504802 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.505030 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.505125 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.505339 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.505433 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.505651 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.505743 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.505963 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.506047 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.506274 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.506367 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.506684 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.506775 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.506975 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.507077 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.507289 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.507373 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.507598 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.507680 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.507905 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.508000 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.508211 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.508296 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.508524 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.508607 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.508834 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.508932 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.509142 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.509226 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.509455 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.509540 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.509763 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.509857 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.510071 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.510155 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.510910 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.510987 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.511239 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.511503 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.511591 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.511760 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.512090 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.512419 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.512732 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.512818 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.513043 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.513129 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.513374 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.513460 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.513691 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.513780 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.514000 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.514095 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.514309 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.514408 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.514650 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.514740 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.514980 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.515065 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.515298 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.515396 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.515604 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.515689 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.515924 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.516008 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.516241 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.516341 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.516554 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.516647 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.516872 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.516957 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.517185 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.517279 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.517499 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.517584 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.517815 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.517901 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.518129 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.518228 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.518440 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.518526 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.518779 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.518877 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.519092 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.519178 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.519404 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.519496 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.519715 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.519798 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.520024 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.520111 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.520338 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.520435 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.520650 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.520734 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.520965 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.521218 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.521304 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.521618 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.521716 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.521869 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.521965 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.522191 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.522434 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.522520 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.522794 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.522998 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.523116 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.523203 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.523441 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.523526 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.523765 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.523859 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.524089 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.524197 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.524420 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.524505 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.524732 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.524820 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.525044 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.525131 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.525360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.525456 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.525669 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.525763 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.526524 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.526649 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.527020 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.527109 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.527343 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.527476 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.527657 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.527751 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.527970 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.528055 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.528277 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.528361 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.528589 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.528688 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.528896 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.528990 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.529208 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.529294 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.529519 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.529613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.529824 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.529910 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.530138 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.530222 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.530450 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.530550 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.530780 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.530869 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.531089 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.531175 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.531396 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.531489 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.531724 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.531845 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.532034 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.532140 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.532342 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.532430 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.532652 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.532740 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.533000 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.533087 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.533310 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.533398 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.533620 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.533703 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.533953 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.534047 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.534267 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.534353 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.534624 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.534715 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.534909 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.535005 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.535225 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.535311 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.535536 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.535620 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.535842 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.535935 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.536149 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.536242 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.536460 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.536543 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.536771 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.536865 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.537080 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.537165 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.537388 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.537483 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.537703 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.537790 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.538012 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.538097 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.538324 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.538409 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.538655 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.538743 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.538965 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.539061 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.539272 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.539360 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.539586 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.539684 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.539894 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.539987 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.540198 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.540291 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.540505 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.540598 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.540815 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.540900 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.541124 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.541219 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.541447 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.541584 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.541780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.541915 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.542081 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.542208 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.542402 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.542529 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.542743 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.542871 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.543056 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.543186 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.543366 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.543514 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.543683 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.543829 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.543999 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.544141 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.544308 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.544451 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.544636 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.544765 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.544952 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.545072 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.545261 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.545380 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.545571 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.545691 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.545887 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.546016 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.546195 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.546335 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.546503 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.546668 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.546843 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.546984 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.547170 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.547290 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.547498 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.547583 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.547809 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.547905 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.548125 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.548210 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.548433 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.548531 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.548741 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.548826 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.549050 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.549134 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.549353 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.549449 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.549658 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.549758 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.549965 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.550065 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.550273 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.550369 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.550591 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.550679 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.550905 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.551002 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.551208 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.551306 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.551534 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.551618 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.551840 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.551923 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.552146 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.552241 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.552455 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.552542 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.552790 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.552874 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.553099 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.553224 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.553408 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.553493 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.553719 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.553804 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.554034 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.554120 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.554339 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.554424 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.554684 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.554790 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.554998 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.555085 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.555310 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.555397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.555617 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.555702 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.555917 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.556008 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.556238 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.556322 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.556546 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.556644 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.556853 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.556945 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.557195 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.557284 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.557523 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.557763 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.557853 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.557934 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.558144 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.558231 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.558456 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.558555 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.558793 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.558881 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.559121 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.559207 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.559437 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.559533 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.559750 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.559844 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.560063 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.560148 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.560377 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.560475 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.560689 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.560784 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.561000 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.561085 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.561310 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.561398 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.561618 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.561703 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.561929 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.562015 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.562242 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.562327 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.562546 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.562649 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.563135 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.563227 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.563452 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.563538 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.563757 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.563841 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.564066 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.564165 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.564371 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.564455 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.564682 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.564776 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.564988 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.565088 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.565313 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.565439 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.565610 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.565732 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.565926 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.566045 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.566236 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.566352 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.566690 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.566779 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.567006 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.567105 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.567318 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.567404 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.567630 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.567716 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.567933 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.568019 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.568247 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.568353 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.568565 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.568652 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.568883 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.568970 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.569194 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.569279 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.569552 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.569635 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.569858 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.569946 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.570167 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.570253 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.570493 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.570630 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.570833 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.570929 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.571140 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.571225 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.571445 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.571545 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.571767 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.571853 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.572073 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.572196 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.572385 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.572480 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.573194 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.573318 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.573651 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.573963 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.574103 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.574456 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.574654 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.574813 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.574900 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.575130 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.575255 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.575460 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.575577 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.575890 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.575975 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.576311 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.576411 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.576631 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.576716 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.576948 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.577033 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.577278 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.577372 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.577608 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.577708 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.577935 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.578020 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.578250 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.578344 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.578612 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.578721 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.578902 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.578990 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.579228 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.579322 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.579549 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.579643 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.579862 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.579948 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.580183 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.580269 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.580493 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.580609 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.580821 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.580942 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.581148 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.581258 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.581467 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.581581 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.581793 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.581909 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.582213 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.582352 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.582518 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.582621 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.582857 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.582942 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.583164 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.583261 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.583473 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.583605 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.583796 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.583881 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.584101 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.584191 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.584415 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.584506 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.584721 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.584807 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.585031 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.585126 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.585338 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.585429 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.585646 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.585733 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.585956 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.586051 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.586263 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.586356 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.586591 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.586680 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.586907 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.587007 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.587216 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.587303 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.587539 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.587623 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.587845 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.587951 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.588167 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.588255 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.589053 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.589253 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.589387 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.589573 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.589700 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.589883 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.590012 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.590193 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.590340 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.590539 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.590706 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.590880 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.590967 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.591204 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.591301 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.591540 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.591633 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.591875 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.591962 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.592191 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.592287 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.592517 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.592604 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.592843 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.592928 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.593164 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.593251 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.593480 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.593566 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.593805 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.593891 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.594111 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.594198 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.594418 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.594504 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.594757 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.594846 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.595065 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.595153 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.595373 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.595461 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.595676 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.595761 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.595986 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.596072 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.596290 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.596375 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.596593 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.596760 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.596899 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.596986 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.597210 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.597295 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.597517 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.597612 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.597823 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.597907 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.598139 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.598233 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.598443 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.598537 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.598777 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.598864 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.599083 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.599168 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.599403 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.599501 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.599713 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.599799 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.600024 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.600111 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.600333 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.600429 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.600658 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.600742 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.600976 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.601069 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.601288 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.601376 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.601613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.601700 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.601930 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.602016 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.602246 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.602371 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.602558 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.602678 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.602898 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.602984 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.603214 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.603309 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.603529 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.603613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.603841 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.604078 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.604321 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.604408 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.604655 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.604854 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.605084 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.605185 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.605410 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.605498 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.605731 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.606010 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.606096 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.606345 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.606439 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.606692 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.606782 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.607014 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.607217 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.607317 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.607554 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.607642 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.607876 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.607962 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.608203 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.608298 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.608522 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.608617 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.608842 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.608929 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.609155 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.609242 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.609467 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.609554 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.609784 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.609871 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.610101 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.610198 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.610417 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.610512 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.610774 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.610872 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.611097 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.611186 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.611417 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.611512 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.611735 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.611831 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.612074 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.612161 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.612393 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.612478 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.612705 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.612794 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.613020 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.613106 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.613333 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.613417 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.613651 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.613739 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.613966 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.614055 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.614280 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.614380 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.614633 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.614737 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.614932 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.615021 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.615244 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.615338 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.615553 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.615639 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.615868 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.615962 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.616182 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.616276 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.616496 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.616582 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.616815 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.616901 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.617132 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.617221 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.617443 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.617527 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.617757 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.617851 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.618077 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.618172 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.618415 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.618616 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.618756 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.618938 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.619077 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.619278 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.619395 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.619650 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.620032 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.620177 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.620359 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.620446 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.620687 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.620773 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.621018 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.621117 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.621331 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.621425 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.621640 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.621733 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.621952 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.622048 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.622264 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.622352 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.622588 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.622725 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.622912 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.623014 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.623224 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.623317 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.623530 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.623616 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.623843 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.623937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.624154 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.624248 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.624478 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.624690 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.624791 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.625042 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.625128 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.625365 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.625461 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.625698 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.625925 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.626014 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.626278 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.626363 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.626624 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.626704 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.626962 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.627050 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.627271 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.627363 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.627582 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.627669 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.627898 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.627984 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.628208 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.628292 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.628518 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.628629 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.628825 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.628918 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.629135 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.629220 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.629448 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.629543 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.629753 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.629837 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.630060 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.630153 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.630362 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.630456 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.630700 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.630794 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.631012 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.631100 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.631315 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.631411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.631622 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.631708 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.631930 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.632015 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.632237 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.632325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.632543 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.632627 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.632848 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.632932 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.633155 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.633242 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.633461 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.633545 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.633765 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.633852 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.634071 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.634159 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.634374 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.634459 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.634713 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.634855 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.635021 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.635109 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.635850 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.635944 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.636168 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.636317 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.636485 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.636572 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.636796 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.636882 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.637113 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.637212 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.637437 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.637521 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.637751 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.637836 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.638079 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.638175 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.638388 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.638473 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.638723 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.638811 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.639040 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.639139 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.639369 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.639456 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.639687 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.639900 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.640005 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.640237 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.640335 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.640566 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.640652 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.640900 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.641168 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.641257 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.641512 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.641598 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.641818 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.641912 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.642127 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.642217 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.642453 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.642547 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.642796 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.642902 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.643106 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.643199 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.643416 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.643501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.643730 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.643829 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.644042 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.644130 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.644355 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.644444 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.644665 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.644759 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.644976 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.645063 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.645285 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.645371 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.645596 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.645693 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.645908 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.646008 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.646216 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.646302 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.646527 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.646675 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.646868 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.646957 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.647184 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.647271 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.647503 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.647599 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.647820 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.647914 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.648135 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.648222 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.648448 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.648536 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.648761 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.648847 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.649073 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.649172 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.649384 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.649471 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.649694 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.649777 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.650007 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.650105 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.650320 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.650405 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.650653 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.650742 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.651517 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.651682 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.651851 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.651948 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.652171 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.652258 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.652484 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.652572 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.652845 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.652932 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.653170 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.653258 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.653495 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.653584 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.653809 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.653898 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.654138 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.654224 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.654453 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.654542 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.654814 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.654903 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.655128 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.655228 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.655456 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.655551 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.655775 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.655864 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.656084 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.656183 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.656393 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.656480 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.656700 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.656801 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.657012 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.657108 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.657333 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.657420 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.657644 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.657730 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.657953 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.658041 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.658261 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.658347 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.658608 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.658698 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.658905 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.658994 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.659213 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.659298 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.659517 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.659610 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.659823 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.659912 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.660129 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.660214 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.660485 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.660579 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.660743 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.660837 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.661049 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.661134 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.661352 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.661449 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.661657 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.661741 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.661960 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.662044 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.662265 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.662362 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.662588 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.662677 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.662895 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.662980 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.663200 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.663299 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.663504 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.663590 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.663806 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.663891 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.664116 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.664279 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.664423 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.664510 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.664731 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.664817 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.665040 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.665166 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.665366 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.665451 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.665690 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.665775 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.666001 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.666096 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.666324 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.666410 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.666711 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.666800 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.667031 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.667163 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.667345 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.667441 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.667679 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.667765 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.667993 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.668081 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.668305 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.668391 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.668616 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.668717 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.668928 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.669014 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.669240 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.669325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.669552 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.669648 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.669883 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.669969 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.670201 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.670287 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.670518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.670633 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.670860 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.670956 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.671175 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.671261 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.671498 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.671593 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.671809 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.671895 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.672118 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.672204 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.672446 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.672532 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.672757 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.672843 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.673068 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.673154 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.673380 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.673466 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.673690 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.673775 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.674003 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.674103 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.674315 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.674400 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.674651 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.674740 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.674965 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.675063 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.675280 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.675376 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.675590 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.675677 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.675907 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.676001 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.676231 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.676316 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.676557 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.676643 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.676873 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.676969 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.677204 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.677300 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.677531 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.677624 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.677849 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.677938 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.678163 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.678248 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.678471 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.678558 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.678743 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 18:03:47.678868 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.679189 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.679506 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.679818 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:03:47.680066 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 18:03:47.702625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG oslo_db.sqlalchemy.engines [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:03:47.704179 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_db.sqlalchemy.engines [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:03:47.766596 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.context [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f72245b9-2fb6-4786-862f-c5dd2343c27b(cell1) {{(pid=102643) load_cells /opt/stack/nova/nova/context.py:464}} May 17 18:03:47.768059 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.context [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f72245b9-2fb6-4786-862f-c5dd2343c27b(cell1) {{(pid=102644) load_cells /opt/stack/nova/nova/context.py:464}} May 17 18:03:47.770924 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG oslo_concurrency.lockutils [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:03:47.772373 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:03:47.772470 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG oslo_concurrency.lockutils [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:03:47.773273 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG oslo_concurrency.lockutils [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:03:47.773930 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:03:47.774756 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:03:47.775260 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG oslo_concurrency.lockutils [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:03:47.776750 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:03:47.788654 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG oslo_db.sqlalchemy.engines [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:03:47.789688 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG oslo_db.sqlalchemy.engines [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:03:47.794130 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_db.sqlalchemy.engines [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:03:47.797958 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_db.sqlalchemy.engines [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:03:47.952562 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG oslo_db.sqlalchemy.engines [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:03:47.967092 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_db.sqlalchemy.engines [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:03:48.304287 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: WARNING keystonemiddleware.auth_token [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:03:48.311163 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: WARNING keystonemiddleware.auth_token [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:03:48.312437 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: WARNING keystonemiddleware.auth_token [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:03:48.318802 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: WARNING keystonemiddleware.auth_token [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:03:48.659804 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: WARNING keystonemiddleware.auth_token [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:03:48.665848 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: WARNING keystonemiddleware.auth_token [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:03:48.668090 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: WARNING keystonemiddleware.auth_token [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:03:48.672032 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a250bf39c0 pid: 102644 (default app) May 17 18:03:48.674111 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:03:48.674207 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: WARNING keystonemiddleware.auth_token [None req-dbe6e24e-6899-4fe8-a316-e0e4023ffdaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:03:48.675346 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001776 May 17 18:03:48.675765 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Tue May 17 18:03:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:03:48.680347 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a250bf39c0 pid: 102643 (default app) May 17 18:05:06.363830 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:06.364824 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 17 18:05:06.365209 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:06.792987 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-baba356f-70e0-4bba-a7c8-f85e6ec6fbd2 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:06.823578 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-baba356f-70e0-4bba-a7c8-f85e6ec6fbd2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.451334 May 17 18:05:06.838609 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Tue May 17 18:05:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:05:09.128100 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:09.129082 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-580a3638-7972-44b5-867f-80df3a0119b6 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 May 17 18:05:09.130227 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:09.190834 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-ba5379b8-03a5-4b7e-afcb-2b2a15b784d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:09.210154 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:05:09.210154 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: warnings.warn(msg) May 17 18:05:09.245438 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-ba5379b8-03a5-4b7e-afcb-2b2a15b784d4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107864 May 17 18:05:09.245989 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 17 18:05:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:05:09.461928 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-cd48a071-db1f-472a-8828-9bc4f9fb8983 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:09.464485 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:05:09.464485 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: warnings.warn(msg) May 17 18:05:09.512787 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-cd48a071-db1f-472a-8828-9bc4f9fb8983 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257909 May 17 18:05:09.513547 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Tue May 17 18:05:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:05:11.786335 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-ba5379b8-03a5-4b7e-afcb-2b2a15b784d4 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:11.788289 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-ba5379b8-03a5-4b7e-afcb-2b2a15b784d4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002396 May 17 18:05:11.789597 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:11.897542 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-bf4ce66c-4096-48cd-9e04-c0847b89723c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "swap": 0}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:11.916387 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:05:11.916387 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: warnings.warn(msg) May 17 18:05:11.935535 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-bf4ce66c-4096-48cd-9e04-c0847b89723c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138702 May 17 18:05:11.936087 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 17 18:05:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:05:11.948357 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-e1be9531-02bc-4d27-a33b-eed7779b71db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:11.949842 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:05:11.949842 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: warnings.warn(msg) May 17 18:05:11.983472 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-e1be9531-02bc-4d27-a33b-eed7779b71db admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038638 May 17 18:05:11.984184 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Tue May 17 18:05:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:05:14.260316 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-bf4ce66c-4096-48cd-9e04-c0847b89723c admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:14.262098 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-bf4ce66c-4096-48cd-9e04-c0847b89723c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002169 May 17 18:05:14.262699 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:14.324681 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-f38f7215-6630-4003-b73d-d1f81d464046 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024, "vcpus": 1}} {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:14.343620 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-f38f7215-6630-4003-b73d-d1f81d464046 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075001 May 17 18:05:14.344476 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 17 18:05:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:05:14.356369 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-be859741-118a-452e-b039-8a49609a2ef8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:14.381809 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-be859741-118a-452e-b039-8a49609a2ef8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029181 May 17 18:05:14.392879 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Tue May 17 18:05:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:05:16.663372 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-f38f7215-6630-4003-b73d-d1f81d464046 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:16.665145 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-f38f7215-6630-4003-b73d-d1f81d464046 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002276 May 17 18:05:16.665572 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:16.727179 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-b132f6b5-0cb6-41a0-831d-b9b229be15cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "swap": 0}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:16.746000 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-b132f6b5-0cb6-41a0-831d-b9b229be15cd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074084 May 17 18:05:16.746649 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 17 18:05:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:05:16.759401 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-fbd62e7d-4345-4430-b95c-cdf2755c15c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:16.782962 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-fbd62e7d-4345-4430-b95c-cdf2755c15c7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027878 May 17 18:05:16.783576 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Tue May 17 18:05:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:05:19.096636 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-b132f6b5-0cb6-41a0-831d-b9b229be15cd admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:19.097635 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-b132f6b5-0cb6-41a0-831d-b9b229be15cd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 17 18:05:19.098030 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:19.155634 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-1954cebb-2010-4716-8cd2-1a6e5df4c1e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "vcpus": 4}} {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:19.175257 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-1954cebb-2010-4716-8cd2-1a6e5df4c1e4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070654 May 17 18:05:19.180394 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 17 18:05:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:05:19.188012 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-70ca8479-8a9d-47a2-8a22-6c38209b76d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:19.211174 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-70ca8479-8a9d-47a2-8a22-6c38209b76d1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026449 May 17 18:05:19.211876 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Tue May 17 18:05:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:05:21.474471 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-1954cebb-2010-4716-8cd2-1a6e5df4c1e4 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:21.475561 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-1954cebb-2010-4716-8cd2-1a6e5df4c1e4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 17 18:05:21.476474 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:21.544324 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-6b24aef0-0c1d-48ff-ab27-6c1225dc4b69 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:21.570552 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-6b24aef0-0c1d-48ff-ab27-6c1225dc4b69 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088104 May 17 18:05:21.579281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Tue May 17 18:05:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:05:23.856291 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-1954cebb-2010-4716-8cd2-1a6e5df4c1e4 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:23.857330 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-1954cebb-2010-4716-8cd2-1a6e5df4c1e4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 17 18:05:23.857736 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:23.919609 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-e49c05a5-11b8-458a-87a2-785e56fa69e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "id": "1"}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:23.939407 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-e49c05a5-11b8-458a-87a2-785e56fa69e5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075535 May 17 18:05:23.939983 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 17 18:05:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:05:23.953241 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-3d1d8f66-b896-44b2-a1d7-401a10444ba1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:23.977914 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-3d1d8f66-b896-44b2-a1d7-401a10444ba1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028130 May 17 18:05:23.979004 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Tue May 17 18:05:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:05:26.442272 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-e49c05a5-11b8-458a-87a2-785e56fa69e5 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:26.443416 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-e49c05a5-11b8-458a-87a2-785e56fa69e5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 May 17 18:05:26.443862 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:26.510062 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-a192f94a-842b-4f82-ba80-502fd1e7c195 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "name": "m1.small", "ram": 2048}} {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:26.530829 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-a192f94a-842b-4f82-ba80-502fd1e7c195 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079892 May 17 18:05:26.531421 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 17 18:05:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:05:26.543995 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-8370a75e-9680-4446-b4d2-2069b228d801 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:26.568350 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-8370a75e-9680-4446-b4d2-2069b228d801 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028297 May 17 18:05:26.568983 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Tue May 17 18:05:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:05:28.834005 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-a192f94a-842b-4f82-ba80-502fd1e7c195 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:28.835054 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-a192f94a-842b-4f82-ba80-502fd1e7c195 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 17 18:05:28.835603 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:28.893213 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-4605d86b-3ecf-4efd-8387-e4546fa7e668 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:28.911838 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-4605d86b-3ecf-4efd-8387-e4546fa7e668 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070284 May 17 18:05:28.912386 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 17 18:05:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:05:28.925032 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-4fcc54f6-a9af-4711-b028-8e82c56c6f15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:28.947304 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-4fcc54f6-a9af-4711-b028-8e82c56c6f15 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025955 May 17 18:05:28.947877 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Tue May 17 18:05:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:05:31.209581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-4605d86b-3ecf-4efd-8387-e4546fa7e668 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:31.211182 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-4605d86b-3ecf-4efd-8387-e4546fa7e668 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 May 17 18:05:31.211686 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:31.271500 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-dd11db85-cdaa-483d-9ffb-221da353b739 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80, "swap": 0, "ram": 8192, "id": "4"}} {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:31.290688 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-dd11db85-cdaa-483d-9ffb-221da353b739 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072521 May 17 18:05:31.291169 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 17 18:05:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:05:31.303160 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-671764c5-357a-46fe-bd0c-2362e7f94556 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:31.326705 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-671764c5-357a-46fe-bd0c-2362e7f94556 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027205 May 17 18:05:31.327289 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Tue May 17 18:05:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:05:33.664622 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-dd11db85-cdaa-483d-9ffb-221da353b739 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:33.666209 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-dd11db85-cdaa-483d-9ffb-221da353b739 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 May 17 18:05:33.666628 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:33.728274 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-67f3ceef-929b-4b5a-b60a-d6d27f4dd6aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:33.750611 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-67f3ceef-929b-4b5a-b60a-d6d27f4dd6aa admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078222 May 17 18:05:33.751226 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 17 18:05:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:05:33.763475 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-25a720c1-f7e8-4d5b-8e1d-e66b363e63cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:05:33.789618 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-25a720c1-f7e8-4d5b-8e1d-e66b363e63cd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029877 May 17 18:05:33.790210 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Tue May 17 18:05:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:05:57.926692 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-67f3ceef-929b-4b5a-b60a-d6d27f4dd6aa admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:57.927706 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-67f3ceef-929b-4b5a-b60a-d6d27f4dd6aa admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 17 18:05:57.928102 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:57.988115 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-d51619b1-fec5-4514-ac1d-1faf6fc4105a admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:58.005611 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-d51619b1-fec5-4514-ac1d-1faf6fc4105a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070716 May 17 18:05:58.006161 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Tue May 17 18:05:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:05:59.000342 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-67f3ceef-929b-4b5a-b60a-d6d27f4dd6aa admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:59.001393 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-67f3ceef-929b-4b5a-b60a-d6d27f4dd6aa admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 17 18:05:59.001783 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:05:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:05:59.212121 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-b90964f7-9875-48b0-98fd-f0463eded5ad admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:59.217620 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.wsgi [None req-b90964f7-9875-48b0-98fd-f0463eded5ad admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-b90964f7-9875-48b0-98fd-f0463eded5ad admin admin] Request method failure captured: May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Accept: application/json May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Accept-Encoding: gzip, deflate May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Connection: keep-alive May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Content-Length: 0 May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Host: 10.222.0.25 May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Openstack-Api-Version: compute 2.90 May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Openstack-System-Scope: None May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: User-Agent: python-novaclient May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Auth-Token: gAAAAABig-QGOD1VYe9RVmaFNuHY3c5NKL5hMp--Yscjdhtsv0U5fWG4RfyIEelEM3bPaocbO1GiZiUaZWq-V5PosiIAyZm45jM-WeO4MLuRTNY7d-uMlUcbxDcpiykssn7n06Zdg_J64E06D7SMs_pnivtIKBdFzdrWlpL1c97gxvKkZiK9gZk May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Domain-Id: None May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Domain-Name: None May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Identity-Status: Confirmed May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Is-Admin-Project: True May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Domain-Id: default May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Domain-Name: Default May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Name: admin May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Role: reader,admin,member May 17 18:05:59.220911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Roles: reader,admin,member May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce77dde206fe428ba1cf2d3583c7c4a2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Tenant: admin May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Tenant-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Tenant-Name: admin May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User: admin May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Domain-Id: default May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Domain-Name: Default May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Id: 019f8abbfcaf48d98532c6915b54e5c0 May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Name: admin May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: method: > May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: exception: Flavor 42 could not be found. May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: action_args: {'id': '42'} May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:05:59.222625 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:05:59.223613 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:05:59.224822 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-b90964f7-9875-48b0-98fd-f0463eded5ad admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:05:59.225973 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-b90964f7-9875-48b0-98fd-f0463eded5ad admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061665 May 17 18:05:59.225973 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Tue May 17 18:05:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 18:05:59.232101 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-b154ccf1-5ecd-44bf-950e-0b4aca8382e3 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:59.253339 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-b154ccf1-5ecd-44bf-950e-0b4aca8382e3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024734 May 17 18:05:59.253877 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 17 18:05:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:05:59.264090 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-7615305a-18e9-4dd3-ac62-c14c1ebee68d admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:59.292672 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-7615305a-18e9-4dd3-ac62-c14c1ebee68d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032102 May 17 18:05:59.293224 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 17 18:05:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:05:59.310174 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-e8bab9d7-3f80-4bbd-adb0-d357e6bcab12 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:05:59.316001 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.wsgi [None req-e8bab9d7-3f80-4bbd-adb0-d357e6bcab12 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-e8bab9d7-3f80-4bbd-adb0-d357e6bcab12 admin admin] Request method failure captured: May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Accept: application/json May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Accept-Encoding: gzip, deflate May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Connection: keep-alive May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Content-Length: 0 May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Host: 10.222.0.25 May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Openstack-Api-Version: compute 2.90 May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Openstack-System-Scope: None May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: User-Agent: python-novaclient May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Auth-Token: gAAAAABig-QGOD1VYe9RVmaFNuHY3c5NKL5hMp--Yscjdhtsv0U5fWG4RfyIEelEM3bPaocbO1GiZiUaZWq-V5PosiIAyZm45jM-WeO4MLuRTNY7d-uMlUcbxDcpiykssn7n06Zdg_J64E06D7SMs_pnivtIKBdFzdrWlpL1c97gxvKkZiK9gZk May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Domain-Id: None May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Domain-Name: None May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Identity-Status: Confirmed May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Is-Admin-Project: True May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Domain-Id: default May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Domain-Name: Default May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Name: admin May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Role: reader,admin,member May 17 18:05:59.319840 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Roles: reader,admin,member May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce77dde206fe428ba1cf2d3583c7c4a2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Tenant: admin May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Tenant-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Tenant-Name: admin May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User: admin May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Domain-Id: default May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Domain-Name: Default May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Id: 019f8abbfcaf48d98532c6915b54e5c0 May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Name: admin May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: method: > May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: exception: Flavor 42 could not be found. May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: action_args: {'id': '42'} May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:05:59.321488 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:05:59.322397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:05:59.323518 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-e8bab9d7-3f80-4bbd-adb0-d357e6bcab12 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:05:59.324563 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-e8bab9d7-3f80-4bbd-adb0-d357e6bcab12 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015008 May 17 18:05:59.324563 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Tue May 17 18:05:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 18:06:00.194869 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-7615305a-18e9-4dd3-ac62-c14c1ebee68d admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:00.195878 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-7615305a-18e9-4dd3-ac62-c14c1ebee68d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 May 17 18:06:00.196268 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:06:00.381152 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-3f4eb287-6d3e-4adf-8338-2dde26a691dc admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:00.387826 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.wsgi [None req-3f4eb287-6d3e-4adf-8338-2dde26a691dc admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-3f4eb287-6d3e-4adf-8338-2dde26a691dc admin admin] Request method failure captured: May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Accept: application/json May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Accept-Encoding: gzip, deflate May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Connection: keep-alive May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Content-Length: 0 May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Host: 10.222.0.25 May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Openstack-Api-Version: compute 2.90 May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Openstack-System-Scope: None May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: User-Agent: python-novaclient May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Auth-Token: gAAAAABig-QIMhze-nGSPFh52Rus9YJywHZAgIVErHmiSc42MhGkC35MWzjdidwLhCsB4_-c3PVnPyEzhx2aLTl7MHxfzOmPDsBkNtxXgyVjt28h6L6cZMd8HttbnW-axq3e-Lt1TMprkKjHyft1GBWFT7EhxdaAocm9qX6yaLQoPy3Tw8a5oyM May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Domain-Id: None May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Domain-Name: None May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Identity-Status: Confirmed May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Is-Admin-Project: True May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Domain-Id: default May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Domain-Name: Default May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Name: admin May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Role: reader,admin,member May 17 18:06:00.389325 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Roles: reader,admin,member May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce77dde206fe428ba1cf2d3583c7c4a2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Tenant: admin May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Tenant-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Tenant-Name: admin May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User: admin May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Domain-Id: default May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Domain-Name: Default May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Id: 019f8abbfcaf48d98532c6915b54e5c0 May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Name: admin May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: method: > May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: exception: Flavor 84 could not be found. May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: action_args: {'id': '84'} May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:06:00.390660 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:06:00.391501 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:06:00.392835 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-3f4eb287-6d3e-4adf-8338-2dde26a691dc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:06:00.394163 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-3f4eb287-6d3e-4adf-8338-2dde26a691dc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060031 May 17 18:06:00.394163 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Tue May 17 18:06:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 18:06:00.401005 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-2a39a2c2-46e1-4e7c-b1fe-549eb7d33f42 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:00.414332 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-2a39a2c2-46e1-4e7c-b1fe-549eb7d33f42 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017535 May 17 18:06:00.414911 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 17 18:06:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:06:00.424021 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-a338de60-e6f3-405f-8610-ff0e18052c7e admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:00.437324 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-a338de60-e6f3-405f-8610-ff0e18052c7e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016796 May 17 18:06:00.437837 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 17 18:06:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:06:00.447442 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-adb3ff26-bc36-46df-8495-465abe5d3c7c admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:00.452454 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.wsgi [None req-adb3ff26-bc36-46df-8495-465abe5d3c7c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-adb3ff26-bc36-46df-8495-465abe5d3c7c admin admin] Request method failure captured: May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Accept: application/json May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Accept-Encoding: gzip, deflate May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Connection: keep-alive May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Content-Length: 0 May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Host: 10.222.0.25 May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Openstack-Api-Version: compute 2.90 May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Openstack-System-Scope: None May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: User-Agent: python-novaclient May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Auth-Token: gAAAAABig-QIMhze-nGSPFh52Rus9YJywHZAgIVErHmiSc42MhGkC35MWzjdidwLhCsB4_-c3PVnPyEzhx2aLTl7MHxfzOmPDsBkNtxXgyVjt28h6L6cZMd8HttbnW-axq3e-Lt1TMprkKjHyft1GBWFT7EhxdaAocm9qX6yaLQoPy3Tw8a5oyM May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Domain-Id: None May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Domain-Name: None May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Identity-Status: Confirmed May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Is-Admin-Project: True May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Domain-Id: default May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Domain-Name: Default May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Name: admin May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Role: reader,admin,member May 17 18:06:00.453937 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Roles: reader,admin,member May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce77dde206fe428ba1cf2d3583c7c4a2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Tenant: admin May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Tenant-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Tenant-Name: admin May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User: admin May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Domain-Id: default May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Domain-Name: Default May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Id: 019f8abbfcaf48d98532c6915b54e5c0 May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Name: admin May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: method: > May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: exception: Flavor 84 could not be found. May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: action_args: {'id': '84'} May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:06:00.455360 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:06:00.456230 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:06:00.457594 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-adb3ff26-bc36-46df-8495-465abe5d3c7c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:06:00.458924 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-adb3ff26-bc36-46df-8495-465abe5d3c7c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011885 May 17 18:06:00.458924 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Tue May 17 18:06:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 18:06:01.350457 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-a338de60-e6f3-405f-8610-ff0e18052c7e admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:01.351616 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-a338de60-e6f3-405f-8610-ff0e18052c7e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 May 17 18:06:01.352012 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:06:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:06:01.542894 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-113a1e05-f404-4b6c-943e-da6f6bf31e46 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:01.548427 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.wsgi [None req-113a1e05-f404-4b6c-943e-da6f6bf31e46 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-113a1e05-f404-4b6c-943e-da6f6bf31e46 admin admin] Request method failure captured: May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Accept: application/json May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Accept-Encoding: gzip, deflate May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Connection: keep-alive May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Content-Length: 0 May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Host: 10.222.0.25 May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Openstack-Api-Version: compute 2.90 May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Openstack-System-Scope: None May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: User-Agent: python-novaclient May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Auth-Token: gAAAAABig-QJmmmHeYmhaiKTpZBd8nrwn7CCEwSC5xx6egzg9_Rz1oGLN30ZbdNgeCe2TGDsbcJjfpCob6owtiqWKBDIn9Hbj9aCB5Lm167BHRcboYqNQbGJKZePWnwSqNE1TIQhzZN0BH5sahFbIylMiAusUUs244qR4DvyR2I5xSqkAu3hbZU May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Domain-Id: None May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Domain-Name: None May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Identity-Status: Confirmed May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Is-Admin-Project: True May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Domain-Id: default May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Domain-Name: Default May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Project-Name: admin May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Role: reader,admin,member May 17 18:06:01.549922 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Roles: reader,admin,member May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce77dde206fe428ba1cf2d3583c7c4a2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Tenant: admin May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Tenant-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-Tenant-Name: admin May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User: admin May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Domain-Id: default May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Domain-Name: Default May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Id: 019f8abbfcaf48d98532c6915b54e5c0 May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: X-User-Name: admin May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: method: > May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: exception: Flavor 451 could not be found. May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: action_args: {'id': '451'} May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:06:01.551482 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:06:01.552516 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: ERROR nova.api.openstack.wsgi May 17 18:06:01.554639 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-113a1e05-f404-4b6c-943e-da6f6bf31e46 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:06:01.555943 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-113a1e05-f404-4b6c-943e-da6f6bf31e46 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058471 May 17 18:06:01.555943 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 17 18:06:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 18:06:01.561600 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-daf6824c-5137-41e3-b3f9-2cb751af03ec admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:01.575763 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-daf6824c-5137-41e3-b3f9-2cb751af03ec admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017758 May 17 18:06:01.576271 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 17 18:06:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:06:01.585253 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:01.598449 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016629 May 17 18:06:01.598997 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 17 18:06:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:06:01.607882 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-805efe4c-aabd-46c4-88e6-a73b36a208c8 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:01.612941 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.wsgi [None req-805efe4c-aabd-46c4-88e6-a73b36a208c8 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-805efe4c-aabd-46c4-88e6-a73b36a208c8 admin admin] Request method failure captured: May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Accept: application/json May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Accept-Encoding: gzip, deflate May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Connection: keep-alive May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Content-Length: 0 May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Host: 10.222.0.25 May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Openstack-Api-Version: compute 2.90 May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Openstack-System-Scope: None May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: User-Agent: python-novaclient May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Auth-Token: gAAAAABig-QJmmmHeYmhaiKTpZBd8nrwn7CCEwSC5xx6egzg9_Rz1oGLN30ZbdNgeCe2TGDsbcJjfpCob6owtiqWKBDIn9Hbj9aCB5Lm167BHRcboYqNQbGJKZePWnwSqNE1TIQhzZN0BH5sahFbIylMiAusUUs244qR4DvyR2I5xSqkAu3hbZU May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Domain-Id: None May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Domain-Name: None May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Identity-Status: Confirmed May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Is-Admin-Project: True May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Domain-Id: default May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Domain-Name: Default May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Project-Name: admin May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Role: reader,admin,member May 17 18:06:01.614411 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Roles: reader,admin,member May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce77dde206fe428ba1cf2d3583c7c4a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce77dde206fe428ba1cf2d3583c7c4a2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Tenant: admin May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Tenant-Id: ce77dde206fe428ba1cf2d3583c7c4a2 May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-Tenant-Name: admin May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User: admin May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Domain-Id: default May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Domain-Name: Default May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Id: 019f8abbfcaf48d98532c6915b54e5c0 May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: X-User-Name: admin May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: method: > May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: exception: Flavor 451 could not be found. May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: action_args: {'id': '451'} May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:06:01.616581 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:06:01.617780 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: ERROR nova.api.openstack.wsgi May 17 18:06:01.619281 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-805efe4c-aabd-46c4-88e6-a73b36a208c8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:06:01.620523 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-805efe4c-aabd-46c4-88e6-a73b36a208c8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011283 May 17 18:06:01.620523 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 17 18:06:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 18:06:02.526830 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:02.527835 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 17 18:06:02.528233 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:06:02.714989 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-0f3c15c8-46a0-4aa9-a4ff-4975598b9ff3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:06:02.737011 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-0f3c15c8-46a0-4aa9-a4ff-4975598b9ff3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072692 May 17 18:06:02.737554 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Tue May 17 18:06:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:06:03.626338 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:03.627368 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 17 18:06:03.627759 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:06:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:06:03.813748 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-cd6435e9-492d-40bf-bd44-4d9c80cfb01e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:06:03.831214 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-cd6435e9-492d-40bf-bd44-4d9c80cfb01e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068398 May 17 18:06:03.831751 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Tue May 17 18:06:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:06:04.711956 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:04.712944 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 17 18:06:04.713347 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:06:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:06:04.900972 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-741844ec-a649-4c7f-9f78-fe24d9322bc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:06:04.918215 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-741844ec-a649-4c7f-9f78-fe24d9322bc5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067827 May 17 18:06:04.918817 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Tue May 17 18:06:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:06:05.798317 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:05.799380 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 17 18:06:05.799782 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:06:05.985351 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-46e19323-6693-4881-9f61-498f5564762c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:06:06.002949 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-46e19323-6693-4881-9f61-498f5564762c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067601 May 17 18:06:06.003475 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Tue May 17 18:06:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:06:06.894817 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:06.895819 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 17 18:06:06.896216 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:06:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:06:07.082142 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-dbabf016-da4a-4c26-ade4-561f6947ccca admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:06:07.101522 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-dbabf016-da4a-4c26-ade4-561f6947ccca admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069613 May 17 18:06:07.102045 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Tue May 17 18:06:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:07:09.056012 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:07:09.057010 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-ac55183c-2d40-4b5c-8fb6-294f7225b1eb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 17 18:07:09.057399 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 17 18:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:07:09.115845 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-0053ad35-5cb9-4362-8ed7-dbf1b65b34d1 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:07:09.135176 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-0053ad35-5cb9-4362-8ed7-dbf1b65b34d1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072003 May 17 18:07:09.135706 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1291 bytes} [Tue May 17 18:07:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:07:09.157787 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-e6d09416-223d-4ced-bd14-2be8779c6447 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:07:09.165336 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-e6d09416-223d-4ced-bd14-2be8779c6447 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011821 May 17 18:07:09.165862 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1282 bytes} [Tue May 17 18:07:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:07:09.177523 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-80429101-6392-4aab-b8e8-bd50ca8a0faa admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:07:09.184989 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-80429101-6392-4aab-b8e8-bd50ca8a0faa admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011603 May 17 18:07:09.185529 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1285 bytes} [Tue May 17 18:07:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:07:09.197200 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-74af3fcd-14fc-4120-aa4d-d5fbf2583ab8 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:07:09.204669 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-74af3fcd-14fc-4120-aa4d-d5fbf2583ab8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010883 May 17 18:07:09.205169 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1285 bytes} [Tue May 17 18:07:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:07:09.216233 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-d7e197c4-83fb-484f-be78-692fa0470613 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:07:09.223521 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-d7e197c4-83fb-484f-be78-692fa0470613 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010812 May 17 18:07:09.224552 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1282 bytes} [Tue May 17 18:07:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:10:40.004733 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-74af3fcd-14fc-4120-aa4d-d5fbf2583ab8 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:40.005741 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-74af3fcd-14fc-4120-aa4d-d5fbf2583ab8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 17 18:10:40.006135 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:10:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:40.284961 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-3bf1da72-7f84-416a-8880-31e1c8bb52c7 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:40.286136 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:10:40.286136 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: warnings.warn(msg) May 17 18:10:40.287348 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-3bf1da72-7f84-416a-8880-31e1c8bb52c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:10:40.287785 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-3bf1da72-7f84-416a-8880-31e1c8bb52c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:10:40.288578 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-3bf1da72-7f84-416a-8880-31e1c8bb52c7 admin admin] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:10:40.289001 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-3bf1da72-7f84-416a-8880-31e1c8bb52c7 admin admin] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:10:40.322467 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-3bf1da72-7f84-416a-8880-31e1c8bb52c7 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149607 May 17 18:10:40.323051 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 17 18:10:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:10:41.228989 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-74af3fcd-14fc-4120-aa4d-d5fbf2583ab8 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:41.229988 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-74af3fcd-14fc-4120-aa4d-d5fbf2583ab8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 17 18:10:41.230382 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:10:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:41.419668 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-b0fc6790-eba4-436d-8cc0-c5cf83d03e58 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:41.421798 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:10:41.421798 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: warnings.warn(msg) May 17 18:10:41.423019 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-b0fc6790-eba4-436d-8cc0-c5cf83d03e58 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:10:41.423464 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-b0fc6790-eba4-436d-8cc0-c5cf83d03e58 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:10:41.424285 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-b0fc6790-eba4-436d-8cc0-c5cf83d03e58 admin admin] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:10:41.424715 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-b0fc6790-eba4-436d-8cc0-c5cf83d03e58 admin admin] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:10:41.444736 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-b0fc6790-eba4-436d-8cc0-c5cf83d03e58 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075762 May 17 18:10:41.445275 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 17 18:10:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:10:52.754535 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-74af3fcd-14fc-4120-aa4d-d5fbf2583ab8 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:52.755611 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-74af3fcd-14fc-4120-aa4d-d5fbf2583ab8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 17 18:10:52.756010 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:10:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:52.947536 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-e62a2ffd-5c34-47aa-b7bb-771c3961eb7e admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:52.948692 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:10:52.948692 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: warnings.warn(msg) May 17 18:10:52.949845 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-e62a2ffd-5c34-47aa-b7bb-771c3961eb7e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:10:52.950275 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-e62a2ffd-5c34-47aa-b7bb-771c3961eb7e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:10:52.951085 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-e62a2ffd-5c34-47aa-b7bb-771c3961eb7e admin admin] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:10:52.952267 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-e62a2ffd-5c34-47aa-b7bb-771c3961eb7e admin admin] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:10:52.976852 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-e62a2ffd-5c34-47aa-b7bb-771c3961eb7e admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081971 May 17 18:10:52.977394 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 17 18:10:52 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:10:53.869858 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: DEBUG nova.api.openstack.wsgi [None req-74af3fcd-14fc-4120-aa4d-d5fbf2583ab8 admin admin] Calling method '>' {{(pid=102643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:53.870884 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: INFO nova.api.openstack.requestlog [None req-74af3fcd-14fc-4120-aa4d-d5fbf2583ab8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 17 18:10:53.871284 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: [pid: 102643|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 17 18:10:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:54.059596 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG nova.api.openstack.wsgi [None req-43a0a813-9483-4b1e-b15c-5c62722f5968 admin admin] Calling method '>' {{(pid=102644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:54.060939 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:10:54.060939 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: warnings.warn(msg) May 17 18:10:54.062158 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-43a0a813-9483-4b1e-b15c-5c62722f5968 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:10:54.062618 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-43a0a813-9483-4b1e-b15c-5c62722f5968 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:10:54.063397 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-43a0a813-9483-4b1e-b15c-5c62722f5968 admin admin] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:10:54.063847 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: DEBUG oslo_concurrency.lockutils [None req-43a0a813-9483-4b1e-b15c-5c62722f5968 admin admin] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:10:54.085249 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: INFO nova.api.openstack.requestlog [None req-43a0a813-9483-4b1e-b15c-5c62722f5968 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076625 May 17 18:10:54.085722 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: [pid: 102644|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 17 18:10:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:11:51.813473 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: Tue May 17 18:11:51 2022 - graceful shutdown triggered... May 17 18:11:51.814010 dv-cinder-841302-3-iscsi devstack@n-api.service[102643]: Gracefully killing worker 1 (pid: 102643)... May 17 18:11:51.814380 dv-cinder-841302-3-iscsi devstack@n-api.service[102644]: Gracefully killing worker 2 (pid: 102644)... May 17 18:11:51.815692 dv-cinder-841302-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 17 18:11:52.813816 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: worker 1 buried after 1 seconds May 17 18:11:52.814294 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: worker 2 buried after 1 seconds May 17 18:11:52.814294 dv-cinder-841302-3-iscsi devstack@n-api.service[102642]: goodbye to uWSGI. May 17 18:11:52.815424 dv-cinder-841302-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 17 18:11:52.815995 dv-cinder-841302-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 17 18:11:52.819029 dv-cinder-841302-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 18:11:52.832774 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 18:11:52.848211 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 18:11:52 2022] *** May 17 18:11:52.848211 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 18:11:52.848211 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 18:11:52.848211 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: nodename: dv-cinder-841302-3-iscsi May 17 18:11:52.848211 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: machine: x86_64 May 17 18:11:52.848211 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: clock source: unix May 17 18:11:52.848211 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: pcre jit disabled May 17 18:11:52.848211 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: detected number of CPU cores: 4 May 17 18:11:52.848211 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: current working directory: / May 17 18:11:52.848211 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: detected binary path: /usr/bin/uwsgi-core May 17 18:11:52.849029 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: your processes number limit is 47680 May 17 18:11:52.849029 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: your memory page size is 4096 bytes May 17 18:11:52.849029 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: detected max file descriptor number: 2048 May 17 18:11:52.849029 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: lock engine: pthread robust mutexes May 17 18:11:52.849029 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: thunder lock: enabled May 17 18:11:52.849029 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 18:11:52.849029 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 18:11:52.895949 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: Python main interpreter initialized at 0x55e95459d9c0 May 17 18:11:52.895949 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: python threads support enabled May 17 18:11:52.895949 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: your server socket listen backlog is limited to 100 connections May 17 18:11:52.895949 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: your mercy for graceful operations on workers is 90 seconds May 17 18:11:52.896422 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: mapped 403077 bytes (393 KB) for 2 cores May 17 18:11:52.896422 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: *** Operational MODE: preforking *** May 17 18:11:52.896665 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: *** uWSGI is running in multiple interpreter mode *** May 17 18:11:52.896665 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: spawned uWSGI master process (pid: 117005) May 17 18:11:52.896872 dv-cinder-841302-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 18:11:52.897562 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: spawned uWSGI worker 1 (pid: 117020, cores: 1) May 17 18:11:52.899436 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: spawned uWSGI worker 2 (pid: 117021, cores: 1) May 17 18:11:52.899436 dv-cinder-841302-3-iscsi devstack@n-api.service[117005]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 18:11:54.116195 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 18:11:54.123493 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 18:11:54.917328 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:11:54.917328 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: from cryptography.utils import int_from_bytes May 17 18:11:54.917606 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:11:54.917606 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: from cryptography.utils import int_from_bytes May 17 18:11:54.923621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:11:54.923621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: from cryptography.utils import int_from_bytes May 17 18:11:54.924606 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:11:54.924606 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: from cryptography.utils import int_from_bytes May 17 18:11:57.353789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 18:11:57.354390 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 18:11:57.354689 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 18:11:57.354986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 18:11:57.355251 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 18:11:57.356440 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.356797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.357131 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.357462 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.357803 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.358123 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.358457 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.358818 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.359160 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.359431 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.359774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.360092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-3-iscsi {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.360425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.360744 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.361066 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.361392 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.361704 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.362037 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.362382 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.363087 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.364701 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.364701 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.364701 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.364994 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.365208 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.365431 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.365751 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.366074 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.366404 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.366745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.367158 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-3-iscsi {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.367484 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.367807 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.368124 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.368552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.368866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.369191 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.369522 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.369853 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.370174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.370497 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.370849 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.371200 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.371530 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.371663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 18:11:57.372081 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 18:11:57.372162 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.372162 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.372440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 18:11:57.372551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.372725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 18:11:57.372856 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.373027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 18:11:57.373133 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.373351 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.373459 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.373616 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.373750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.373914 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.374067 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.374240 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.374400 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.374564 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.374738 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.374917 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.375143 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.375300 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.375458 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.375602 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.375757 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.375929 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.376082 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.376253 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.376410 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.376562 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.376713 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.376865 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.377008 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-3-iscsi {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.377160 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.377313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.377455 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.377618 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.377760 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.377912 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.378061 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.378217 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.378367 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.378522 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.378712 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.378917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.379075 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.379227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.379397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.379397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.379688 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.379847 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.380000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.380142 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.380294 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.380462 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.380618 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.380777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.380937 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.381087 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.381229 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.381385 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.381555 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.381712 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.381857 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.381998 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.382147 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.382297 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.382455 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.382631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.383383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.383546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.383699 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-3-iscsi {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.383852 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.384014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.384157 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.384325 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.384469 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.384618 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.384766 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.384927 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.385077 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.385077 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.385356 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.385504 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.385656 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.385805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.385965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.386108 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.386270 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.387162 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.387287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.387379 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.387466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.387542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.387625 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.387625 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.387773 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.387849 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.387923 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.388003 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.388086 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.388162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.388253 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.388358 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.388449 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.388537 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.388631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.388803 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.388910 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.389000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.389154 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.389348 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.389514 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.389672 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.389829 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.389974 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.390116 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.390268 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.390412 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.390598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.390766 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.390911 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.391064 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.391226 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.391379 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.391531 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.391685 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.391843 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.391987 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.392128 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.392271 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.392421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.392573 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.392740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.393485 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.393651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.393812 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.394045 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.394201 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.394355 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.394499 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.394669 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.394816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.394968 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.395126 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.395270 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.395414 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.395563 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.395717 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.395866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.396022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.396173 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.396326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.396471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.396471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.396740 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.396740 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.397028 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.397028 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.397299 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.397451 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.397616 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.397774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.397928 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.398078 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.398221 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.398370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.398513 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.398695 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.398847 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.398990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.399139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.399297 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.399454 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.399618 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.399767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.399917 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.400060 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.400201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.400356 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.400498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.400650 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.400793 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.400942 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.401085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.401236 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.401236 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.401531 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.401675 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.401824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.401975 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.402127 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.402891 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.403697 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.403858 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.404012 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.404280 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.404429 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.404581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.404735 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.404878 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.405020 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.405179 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.405331 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.405474 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.405615 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.405769 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.405926 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.406084 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.406234 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.406385 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.406528 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.406707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.406851 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.407005 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.407155 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.407306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.407448 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.407591 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.408283 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.408451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.408597 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.408740 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.408882 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.409036 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.409190 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.409341 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.409499 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.409729 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.409887 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.410042 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.410187 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.410338 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.410338 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.410691 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.410851 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.411146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.411324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.411471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.411621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.411779 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.411923 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.412065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.412208 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.412350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.412501 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.412656 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.412817 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.412968 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.413112 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.413759 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.413922 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.414067 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.414218 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.414548 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.414725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.414871 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.415035 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.415186 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.415330 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.415471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.415612 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.415762 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.415929 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.416085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.416235 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.416386 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.416529 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.416670 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.416819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.417042 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.417194 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.417337 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.417480 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.417621 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.417780 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.418035 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.418760 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.418919 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.419075 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.419227 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.419385 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:11:57.419538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.419681 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.419831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.419982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.420126 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.420277 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.420432 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.420584 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.420735 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.420878 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.421021 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.421172 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.421315 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.421465 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.421465 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.421746 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.421897 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.422049 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.422201 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.422353 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.422505 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.422694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.422857 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.423008 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.423151 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.423293 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.423904 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.424077 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.424077 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.424374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.424709 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.424871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.425015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.425165 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.425319 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.425469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.425612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.425755 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.425906 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.426049 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.426200 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.426343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.426484 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.426656 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.426816 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.426969 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.427120 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.427263 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.427405 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.427555 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.427705 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.427857 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.428001 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.428143 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.428292 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.428435 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.428576 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.428742 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.428892 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.429037 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.429178 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.429331 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.429483 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.429626 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.429775 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.429925 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.430068 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.430218 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.430374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.430526 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.430691 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.430835 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.430987 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.431140 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.431297 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.431440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.431583 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.431725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.431874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.432017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.432168 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.432311 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.432470 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.432614 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.432765 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.432916 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.433073 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.433217 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.433358 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.433540 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.434133 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.434294 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.434448 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.434641 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.434959 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.435131 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.435276 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.435429 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.435581 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.435724 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.435866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.436008 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.436149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.436310 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.436461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.436604 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.436745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.436887 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.437039 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.437192 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.437343 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.437495 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.437645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.437798 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.437954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.438098 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.438248 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.438399 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.438541 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.438710 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.438871 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.439032 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.439186 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.439337 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.439488 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.439632 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.439787 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.439937 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.440345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.440496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.440639 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.440789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.441540 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.441700 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.441859 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.442003 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.442145 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.442553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.442768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.443173 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.443346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.443492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.443663 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.444410 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.444565 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.444724 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.444897 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.445241 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.445395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.445546 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.445697 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.445852 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.446003 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.446154 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.446297 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.446439 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.446609 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.446793 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.446945 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.447089 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.447231 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.447372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.447514 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.447670 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.447823 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.447966 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.448107 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.448395 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.448657 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.448901 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.449062 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.449239 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.449396 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.449539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.449697 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.449871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.450062 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.450208 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.450407 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.450551 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.450790 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.450944 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.451089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.451250 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.451401 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.451552 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.451552 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.452435 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.452582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.452740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.452895 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.453047 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.453201 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.453345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.453488 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.453630 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.453791 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.453974 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.454658 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.454894 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.455074 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.455446 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.455607 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.455766 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.456359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.456551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.456666 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.456755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.456874 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.457087 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.457181 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.457274 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.457369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.457462 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.457549 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.457644 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.457730 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.457823 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.457916 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.458009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.458096 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.458189 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.458276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.458361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.458446 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.458537 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.458734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.458827 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.458921 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459008 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459093 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459178 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459277 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459461 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459545 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459639 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459733 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459838 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.459925 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460103 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460459 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460638 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460830 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.460930 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461024 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461110 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461194 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461278 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461487 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461673 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461860 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.461974 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.462061 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.462146 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.462238 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.462332 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.462441 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.462542 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.462662 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.462758 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.462844 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.462938 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463037 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463124 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463300 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463385 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463562 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463747 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463833 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.463917 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.464008 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.464108 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.464384 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.464482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.465257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.465399 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.465648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.465757 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.465854 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.465948 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466042 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466128 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466400 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466485 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466613 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466715 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466903 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.466996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.467096 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.467183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.467296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.467296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.467470 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.467556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.467641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.467733 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.467827 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.467921 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468014 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468300 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468385 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468643 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468737 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468823 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468907 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.468998 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.469083 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.469167 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.469265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.469358 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.469443 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.469534 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.469627 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.469712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.469804 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.469898 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.470048 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.470203 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.470364 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.470521 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.470702 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.470874 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.471024 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.471188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.471337 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.471541 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.471658 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.471858 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.471960 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.472171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.472271 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.472496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.472598 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.472822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.472914 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.473139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.473232 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.473459 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.473561 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.473776 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.473869 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.474093 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.474199 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.474423 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.474595 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.474768 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.474895 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.475088 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.475207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.475412 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.475549 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.475720 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.475840 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.476040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.476152 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.476348 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.476446 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.476657 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.476757 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.476967 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.477061 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.477283 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.477385 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.477594 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.477686 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.477903 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.478004 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.478218 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.478311 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.478534 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.478799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.478932 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.479178 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.479338 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.479488 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.479573 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.480584 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.480707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.480785 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.480866 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.480941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.481013 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.481099 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.481181 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.481256 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.481328 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.481512 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.481658 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.481831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.482016 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.482147 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.482337 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.482459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.483293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.483437 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.483529 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.483627 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.483729 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.483817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.483909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.484158 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.484475 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.484795 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.484944 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.485114 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.485216 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.485423 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.485548 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.485777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.486036 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.486188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.486337 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.486480 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.486652 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.486739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.486829 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.487007 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.487146 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.487317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.487469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.487631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.487800 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.488064 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.488174 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.488279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.488444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.488609 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.488805 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.488901 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.489087 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.489222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.489409 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.489537 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.489729 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.489850 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.490045 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.490150 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.490365 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.490467 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.490749 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.490864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.491069 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.491171 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.491418 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.491518 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.491733 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.491832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.492045 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.492137 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.492377 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.492478 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.492695 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.492789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.493008 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.493108 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.493324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.493417 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.493634 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.493732 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.493948 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.494050 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.494269 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.494372 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.494605 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.494727 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.494927 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.495037 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.495248 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.495405 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.495571 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.495701 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.495889 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.496683 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.496779 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.496900 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.497057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.497235 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.497451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.497555 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.497767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.497860 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.498094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.498197 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.498414 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.498523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.499048 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.499187 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.499284 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.499378 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.499479 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.499574 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.499662 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.499756 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.499954 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.500056 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.500273 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.500368 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.500585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.500678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.500914 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.501009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.501228 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.501323 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.501540 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.501641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.501850 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.501943 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.502166 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.502269 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.502482 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.502607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.502817 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.502929 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.503134 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.503226 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.503454 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.503554 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.503763 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.503928 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.504074 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.504176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.504390 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.504490 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.504701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.504834 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.505018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.505123 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.505329 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.505436 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.505637 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.505745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.505968 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.506060 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.506281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.506380 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.506677 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.506796 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.506928 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.507021 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.507237 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.507329 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.507549 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.507642 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.507856 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.507947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.508163 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.508299 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.508476 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.508622 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.508788 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.508942 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.509100 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.509255 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.509413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.509574 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.509745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.509894 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.510061 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.510218 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.510373 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.510547 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.510710 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.510882 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.511054 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.511305 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.511409 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.511645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.511751 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.512479 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.512799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.512907 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.513110 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.513203 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.513422 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.513524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.513739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.513841 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.514069 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.514163 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.514381 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.514475 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.514716 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.514853 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.515034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.515220 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.515368 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.515501 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.515683 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.515779 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.516010 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.516113 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.516392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.516493 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.516705 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.516868 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.517034 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.517130 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.517356 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.517450 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.517676 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.517770 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.518004 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.518106 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.518335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.518439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.518698 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.518807 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.519012 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.519114 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.519328 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.519430 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.519642 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.519742 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.519957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.520050 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.520270 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.520372 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.520586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.520689 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.520905 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.521007 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.521223 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.521330 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.521533 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.521627 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.521850 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.521942 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.522168 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.522271 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.522481 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.522622 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.522836 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.522937 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.523205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.523305 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.523517 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.523637 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.523852 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.523971 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.524170 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.524267 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.524481 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.524576 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.524796 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.524890 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.525133 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.525227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.525408 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.525575 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.525716 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.525865 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.526094 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.526197 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.526355 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.526450 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.526690 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.526802 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.527057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.527163 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.527352 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.527591 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.527710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.527925 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.528048 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.528248 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.528343 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.528573 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.528667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.528881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.528980 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.529206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.529305 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.529527 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.529630 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.529856 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.529957 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.530183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.530276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.530499 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.530616 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.530856 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.530951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.531172 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.531273 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.531483 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.531585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.531793 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.531887 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.532103 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.532208 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.532418 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.532520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.532748 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.532843 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.533061 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.533169 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.533390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.533493 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.533721 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.533815 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.534040 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.534216 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.534381 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.534475 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.534741 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.534858 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.535145 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.535267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.535387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.535482 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.535718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.535812 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.536028 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.536122 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.536339 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.536444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.536650 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.536743 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.536961 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.537063 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.537300 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.537399 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.537568 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.537662 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.537879 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.537982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.538187 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.538288 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.538495 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.538612 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.538830 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.538927 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.539158 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.539260 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.539469 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.539571 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.539789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.539880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.540100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.540193 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.540415 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.540528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.540725 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.540843 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.541267 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.541375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.541471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.541577 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.541665 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.541807 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.541987 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.542121 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.542312 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.542418 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.542661 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.542775 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.543135 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.543299 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.543538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.543706 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.543871 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.544070 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.544198 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.544388 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.544522 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.544712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.544846 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.545035 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.545168 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.545353 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.545491 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.545666 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.545804 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.545983 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.546117 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.546313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.546473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.546649 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.546755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.546981 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.547083 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.547309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.547430 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.547644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.547913 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.548025 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.548253 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.548373 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.548577 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.548763 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.548892 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.548999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.549204 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.549309 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.549520 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.549614 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.549834 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.549944 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.550149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.550252 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.550472 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.550590 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.550819 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.550925 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.551137 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.551232 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.551472 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.551574 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.551790 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.551889 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.552119 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.552221 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.552451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.552551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.552772 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.552870 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.553094 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.553196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.553416 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.553517 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.553724 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.553826 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.554034 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.554129 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.554351 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.554446 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.554685 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.554801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.554997 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.555139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.555308 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.555436 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.555620 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.555714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.555930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.556039 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.556241 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.556343 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.556553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.556657 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.556873 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.556972 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.557182 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.557281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.557505 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.557621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.557815 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.557923 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.558123 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.558224 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.558434 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.559049 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.559321 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.559458 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.559652 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.559898 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.559993 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.560216 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.560316 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.560561 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.560656 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.560885 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.561113 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.561214 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.561436 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.561530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.561777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.561884 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.562112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.562214 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.562444 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.562547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.562795 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.562900 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.563120 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.563222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.563444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.563546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.563756 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.563849 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.564070 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.564172 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.564388 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.564496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.564732 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.564823 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.565003 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.565095 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.565323 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.565421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.565638 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.565772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.565952 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.566183 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.566321 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.566524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.566656 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.566871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.567130 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.567473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.567741 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.567875 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.568061 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.568163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.568382 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.568475 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.568703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.568811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.569022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.569116 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.569333 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.569425 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.569649 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.569755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.569967 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.570067 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.570280 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.570381 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.570624 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.570722 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.570954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.571046 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.571267 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.571371 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.571578 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.571680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.571896 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.571989 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.572212 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.572314 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.572522 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.572616 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.572838 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.572932 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.573151 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.573252 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.573486 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.573578 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.573800 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.573892 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.574170 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.574790 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.575040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.575184 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.575359 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.575451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.575680 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.575831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.575995 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.576091 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.576305 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.576407 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.576617 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.576719 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.576937 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.577041 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.577247 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.577347 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.577562 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.577663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.577875 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.577989 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.578193 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.578297 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.578500 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.578665 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.578842 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.578936 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.579173 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.579265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.579519 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.579702 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.579828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.580027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.580134 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.580369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.580463 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.580701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.580796 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.581034 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.581129 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.581360 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.581453 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.581674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.581765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.582014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.582107 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.582329 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.582431 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.582664 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.582911 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.583004 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.583254 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.583361 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.583584 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.583679 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.583911 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.584004 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.584232 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.584333 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.584544 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.584636 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.584856 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.584949 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.585170 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.585265 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.585499 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.585784 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.585902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.586075 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.586192 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.586405 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.586499 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.586769 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.586863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.587110 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.587216 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.587422 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.587523 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.587738 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.588057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.588163 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.588369 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.588466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.588681 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.588772 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.588995 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.589089 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.589310 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.589403 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.589620 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.589755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.589999 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.590174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.590318 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.590506 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.590660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.590867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.590963 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.591194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.591295 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.591521 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.591615 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.591841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.591935 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.592158 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.592259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.592476 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.592571 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.592793 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.592896 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.593114 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.593216 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.593431 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.593525 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.593747 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.593849 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.594060 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.594160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.594373 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.594475 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.594719 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.594817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.595035 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.595127 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.595353 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.595523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.595666 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.595768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.595996 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.596111 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.596283 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.596389 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.596598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.596701 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.596955 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.597053 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.597287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.597381 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.597599 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.597692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.597910 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.598003 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.598235 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.598376 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.598551 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.598691 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.598901 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.599004 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.599211 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.599395 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.599522 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.599724 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.599840 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.600082 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.600184 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.600410 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.600503 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.600775 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.600954 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.601085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.601300 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.601393 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.601638 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.601738 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.601980 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.602089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.602287 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.602387 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.602617 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.602725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.602936 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.603044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.603246 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.603340 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.603555 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.603646 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.603908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.604016 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.604173 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.604267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.604483 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.604576 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.604793 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.604887 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.605105 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.605198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.605941 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.606073 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.606262 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.606368 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.606566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.606760 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.606902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.607044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.607213 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.607306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.607527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.607620 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.607843 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.607952 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.608166 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.608285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.608506 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.608619 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.608819 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.608930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.609146 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.609247 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.609459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.609598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.609786 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.609892 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.610108 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.610202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.610429 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.610521 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.610770 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.610865 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.611091 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.611196 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.611417 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.611518 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.611734 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.611827 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.612052 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.612145 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.612369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.612469 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.612686 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.612785 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.613001 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.613093 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.613335 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.613427 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.613669 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.613763 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.613980 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.614072 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.614312 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.614413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.614659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.614758 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.614990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.615095 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.615314 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.615416 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.615631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.615731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.615964 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.616056 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.616302 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.616441 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.616602 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.616696 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.616928 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.617022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.617244 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.617337 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.617558 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.617651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.617871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.617971 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.618188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.618290 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.618529 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.618743 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.618873 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.618980 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.619157 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.619260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.619471 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.619569 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.619785 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.619888 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.620098 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.620199 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.620410 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.620510 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.620720 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.620847 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.621079 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.621214 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.621465 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.621586 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.621786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.621892 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.622100 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.622194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.622348 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 18:11:57.622440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.622744 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.623058 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.623371 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.623691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.624005 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.624319 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.624632 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.624944 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.625253 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.625593 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.625938 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.626263 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.626623 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.626946 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.627277 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.627594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.627924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.628255 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.628582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.628904 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.629246 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.629564 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.629884 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.630202 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.630520 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.630861 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.631178 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.631513 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.631853 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.632166 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.632500 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.632827 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.633156 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.633479 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.633799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.634136 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.634832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.634832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.635107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.635427 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.635745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.636069 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.636392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.637302 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.637648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.637970 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.638308 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.638666 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.639025 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.639346 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.639701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.640042 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.640365 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.641506 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.641506 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:11:57.641506 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 18:11:57.645974 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_db.sqlalchemy.engines [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117020) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:11:57.664376 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_db.sqlalchemy.engines [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:11:57.711918 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.context [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f72245b9-2fb6-4786-862f-c5dd2343c27b(cell1) {{(pid=117020) load_cells /opt/stack/nova/nova/context.py:464}} May 17 18:11:57.716478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:11:57.718081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:11:57.718936 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:11:57.720922 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:11:57.729015 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.context [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f72245b9-2fb6-4786-862f-c5dd2343c27b(cell1) {{(pid=117021) load_cells /opt/stack/nova/nova/context.py:464}} May 17 18:11:57.732896 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_db.sqlalchemy.engines [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117020) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:11:57.733937 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:11:57.734167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_db.sqlalchemy.engines [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117020) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:11:57.735621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:11:57.736462 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:11:57.738511 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:11:57.750694 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_db.sqlalchemy.engines [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:11:57.752514 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_db.sqlalchemy.engines [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:11:57.895030 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_db.sqlalchemy.engines [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117020) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:11:57.911828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_db.sqlalchemy.engines [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:11:58.222110 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: WARNING keystonemiddleware.auth_token [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:11:58.229619 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: WARNING keystonemiddleware.auth_token [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:11:58.258434 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: WARNING keystonemiddleware.auth_token [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:11:58.266552 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: WARNING keystonemiddleware.auth_token [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:11:58.589142 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: WARNING keystonemiddleware.auth_token [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:11:58.596070 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: WARNING keystonemiddleware.auth_token [None req-b6fea28a-b3c8-4c17-8456-013425e4aaa7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:11:58.601465 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e95459d9c0 pid: 117020 (default app) May 17 18:11:58.616951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: WARNING keystonemiddleware.auth_token [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:11:58.623300 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: WARNING keystonemiddleware.auth_token [None req-ccccd75e-6f27-4665-ac94-5e6d3446d5f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:11:58.628632 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e95459d9c0 pid: 117021 (default app) May 17 18:12:41.461615 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d04e7db5-c874-4462-b354-e02aa76070f6 tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Action: 'create', calling method: .version_select at 0x7f74b9db5280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-611843647", "metadata": {"Type": "work"}}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:12:41.796462 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-54c11749-ae3a-400d-9650-8cb3205e64a4 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Action: 'create', calling method: .version_select at 0x7f74b9db4280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1461625282"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:12:43.732842 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d04e7db5-c874-4462-b354-e02aa76070f6 tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.344285 May 17 18:12:43.741702 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Tue May 17 18:12:40 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3355 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 18:12:43.752480 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9fae5212-f56e-4f80-a13d-f229b55c1586 tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Calling method '.version_select at 0x7f74b9c0e280>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:43.819393 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-54c11749-ae3a-400d-9650-8cb3205e64a4 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.285288 May 17 18:12:43.820041 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1154 bytes} [Tue May 17 18:12:40 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3288 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 18:12:43.833389 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b73ea2e7-7651-479d-990b-ada8105a3f3f tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b9c0e280>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:43.936471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9fae5212-f56e-4f80-a13d-f229b55c1586 tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb" status: 200 len: 352 microversion: 2.1 time: 0.191784 May 17 18:12:43.942183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:43 2022] GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb => generated 352 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:44.048322 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b73ea2e7-7651-479d-990b-ada8105a3f3f tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd" status: 200 len: 345 microversion: 2.1 time: 0.219262 May 17 18:12:44.048901 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:43 2022] GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd => generated 345 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:44.108089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1436033432", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "networks": [{"uuid": "79ffc347-5e31-43fd-9586-1d4928431cba"}]}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:12:44.328209 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] validate_networks() for [('79ffc347-5e31-43fd-9586-1d4928431cba', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:12:44.956793 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-353575c1-1c27-4115-b719-b0a7da7eba19 tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Calling method '.version_select at 0x7f74b9c0e430>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:45.107636 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-353575c1-1c27-4115-b719-b0a7da7eba19 tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb" status: 200 len: 353 microversion: 2.1 time: 0.161396 May 17 18:12:45.109076 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:44 2022] GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:45.114044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-eb4f9181-2aea-43fe-b214-6b84620bf59d tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b9c0ea60>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:45.198873 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-eb4f9181-2aea-43fe-b214-6b84620bf59d tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd" status: 200 len: 346 microversion: 2.1 time: 0.088623 May 17 18:12:45.202725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:45 2022] GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:45.208044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f431f6ed-95bc-4745-8931-189c5f7062fd tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Calling method '.version_select at 0x7f74b9c14160>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:45.363377 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f431f6ed-95bc-4745-8931-189c5f7062fd tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb" status: 200 len: 353 microversion: 2.1 time: 0.159015 May 17 18:12:45.369002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 5/7] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:45 2022] GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb => generated 353 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:45.379637 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b5a5846c-a1f7-457b-9605-f15e695259c8 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Action: 'create', calling method: .version_select at 0x7f74b9c0edc0>, body: {"snapshot": {"volume_id": "15f9e489-44b5-498f-ba0e-d805900332cd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-913046565"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:12:45.896094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b5a5846c-a1f7-457b-9605-f15e695259c8 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.521576 May 17 18:12:45.904078 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 6/8] 10.222.0.25 () {60 vars in 1161 bytes} [Tue May 17 18:12:45 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:45.905491 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4170ab8b-d366-4217-863f-5cd5ade4907a tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Calling method '.version_select at 0x7f74b9c0e550>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:46.060119 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4170ab8b-d366-4217-863f-5cd5ade4907a tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb" status: 202 len: 0 microversion: 2.1 time: 0.159730 May 17 18:12:46.061859 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 7/9] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 17 18:12:45 2022] DELETE /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:12:46.068014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-35a6e764-3aeb-42d1-9f2f-e3c8cc5ecdf1 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b9c14700>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:46.128652 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-35a6e764-3aeb-42d1-9f2f-e3c8cc5ecdf1 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6" status: 200 len: 286 microversion: 2.1 time: 0.062286 May 17 18:12:46.132869 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 8/10] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 17 18:12:46 2022] GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:46.141049 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a3e285a3-9219-437e-ae6e-652a19ef2972 tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Calling method '.version_select at 0x7f74b9c0e310>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:46.304656 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a3e285a3-9219-437e-ae6e-652a19ef2972 tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb" status: 200 len: 352 microversion: 2.1 time: 0.170361 May 17 18:12:46.306151 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 9/11] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:46 2022] GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb => generated 352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:46.315223 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d6b144b1-b5d6-4884-800b-b8e5c5624e13 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b9c0e940>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:46.414046 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d6b144b1-b5d6-4884-800b-b8e5c5624e13 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.103679 May 17 18:12:46.414677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 10/12] 10.222.0.25 () {58 vars in 1139 bytes} [Tue May 17 18:12:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:46.426030 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-48490b1e-f6fb-4e64-a773-b045720b6b6f tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b9c14430>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:46.484352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-48490b1e-f6fb-4e64-a773-b045720b6b6f tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6" status: 200 len: 286 microversion: 2.1 time: 0.062227 May 17 18:12:46.488569 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 11/13] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 17 18:12:46 2022] GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:12:47.318437 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f87aec76-55a3-4e32-ab6f-d77b5920e66f tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Calling method '.version_select at 0x7f74b9c0edc0>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:47.462010 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f87aec76-55a3-4e32-ab6f-d77b5920e66f tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb" status: 200 len: 352 microversion: 2.1 time: 0.147673 May 17 18:12:47.462877 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 12/14] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:47 2022] GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:47.499202 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c74fff3a-ad6c-4edf-bff3-a75175d76642 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b9c0e670>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:47.631209 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c74fff3a-ad6c-4edf-bff3-a75175d76642 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6" status: 200 len: 286 microversion: 2.1 time: 0.135904 May 17 18:12:47.631991 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 13/15] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 17 18:12:47 2022] GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:12:47.771762 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:12:47.773231 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:12:47.774390 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:12:47.775075 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:12:47.776304 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:12:47.805914 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:12:47.806508 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:12:47.811201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:12:47.811821 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:12:47.881275 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Getting quotas for project 3e1803826fca42f686f47bd2032828b1. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:12:47.889245 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Getting quotas for user c520132de15345be9472b792965323a3 and project 3e1803826fca42f686f47bd2032828b1. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:12:47.917173 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:12:47.924740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:12:48.089574 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-910fdb58-6ad3-4b0a-84f4-bef6e22311bf tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.079972 May 17 18:12:48.102042 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 3/16] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:12:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 4092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:12:48.109177 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6a8bf4f4-cb32-4c06-9fca-873fe13de5d9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:48.110004 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6a8bf4f4-cb32-4c06-9fca-873fe13de5d9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:12:48.477486 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ceaa7327-0c75-4400-bc9e-66157ba42650 tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Calling method '.version_select at 0x7f74b9313e50>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:48.661940 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ceaa7327-0c75-4400-bc9e-66157ba42650 tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb" status: 200 len: 352 microversion: 2.1 time: 0.190307 May 17 18:12:48.669184 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 4/17] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:48 2022] GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb => generated 352 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:48.683626 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-deb690ce-8dd5-41e2-ab8c-29bffb858381 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b932b5e0>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:48.741587 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-deb690ce-8dd5-41e2-ab8c-29bffb858381 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6" status: 200 len: 286 microversion: 2.1 time: 0.070798 May 17 18:12:48.747003 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 5/18] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 17 18:12:48 2022] GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:48.756425 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6a8bf4f4-cb32-4c06-9fca-873fe13de5d9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:12:48.785879 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6a8bf4f4-cb32-4c06-9fca-873fe13de5d9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1215 microversion: 2.1 time: 0.683845 May 17 18:12:48.792374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 14/19] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:12:48 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1215 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:12:49.113358 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-31b6ba66-1b95-4c93-bac0-5beffa1ba186 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Action: 'create', calling method: .version_select at 0x7f74b932bca0>, body: {"keypair": {"name": "tempest-keypair-881682926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJpkcwL4hYUYN0OSD+/fZkjX+pVtcKpoDUm1KPilpkji0qkQ9mGjyK4ZovZ2kXr468UTzOQBIj5ZTJXSRYxXQo02piHPyjYte1wNFwzwkDHkwg9QaJlvEVM7gHwRBaO5A=="}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:12:49.173213 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-31b6ba66-1b95-4c93-bac0-5beffa1ba186 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Getting quotas for project 492389142d804ad392267cb4a728008d. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:12:49.186561 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-31b6ba66-1b95-4c93-bac0-5beffa1ba186 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Getting quotas for user 8ba97b67ecf64476a630fd3667d617fb and project 492389142d804ad392267cb4a728008d. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:12:49.303647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-31b6ba66-1b95-4c93-bac0-5beffa1ba186 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.291624 May 17 18:12:49.304357 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 6/20] 10.222.0.25 () {62 vars in 1199 bytes} [Tue May 17 18:12:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 293 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 17 18:12:49.675461 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-27543c5d-48d8-4c23-b998-7778a544899a tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Calling method '.version_select at 0x7f74b9bdc040>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:49.748994 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-27543c5d-48d8-4c23-b998-7778a544899a tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] HTTP exception thrown: Volume f4524826-887f-40fa-a446-4154bf607eeb could not be found. May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-27543c5d-48d8-4c23-b998-7778a544899a tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Request method failure captured: May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb HTTP/1.1 May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WYWZRved1TkjvE4Io43-tfRtczHLSXX9GPYY6jyS-PLocGjHELJtbDG9rKhanxIryb1D0fZnvL4tRd8zNy6_nobySwGOQrIEGR1vw_i1AnzElliHy7WoS_F5MnIeCG37sAfjmI1iyRN1f7F1TUpYreQC9k1r1MLL_p4PFNzRiJLLU May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 69fb47a4ee9d4f03b6d1bd55075af2fd May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-VolumesGetTestJSON-861347057 May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:12:49.753530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69fb47a4ee9d4f03b6d1bd55075af2fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69fb47a4ee9d4f03b6d1bd55075af2fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69fb47a4ee9d4f03b6d1bd55075af2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69fb47a4ee9d4f03b6d1bd55075af2fd", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-VolumesGetTestJSON-861347057 May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 69fb47a4ee9d4f03b6d1bd55075af2fd May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-VolumesGetTestJSON-861347057 May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-VolumesGetTestJSON-861347057-project May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: a502437b0aa84ee0afc7a1d9a637e0c7 May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-VolumesGetTestJSON-861347057-project May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Volume f4524826-887f-40fa-a446-4154bf607eeb could not be found. May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': 'f4524826-887f-40fa-a446-4154bf607eeb'} May 17 18:12:49.755453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4524826-887f-40fa-a446-4154bf607eeb could not be found. (HTTP 404) (Request-ID: req-c1f55064-b7c3-4f64-8a7d-e04fc8dc2645) May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:49.756261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:12:49.757617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4524826-887f-40fa-a446-4154bf607eeb could not be found. May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 18:12:49.758545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4524826-887f-40fa-a446-4154bf607eeb could not be found. May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4524826-887f-40fa-a446-4154bf607eeb could not be found. May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-27543c5d-48d8-4c23-b998-7778a544899a tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] Returning 404 to user: Volume f4524826-887f-40fa-a446-4154bf607eeb could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:12:49.759691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-27543c5d-48d8-4c23-b998-7778a544899a tempest-VolumesGetTestJSON-861347057 tempest-VolumesGetTestJSON-861347057-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb" status: 404 len: 109 microversion: 2.1 time: 0.084341 May 17 18:12:49.762754 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d594de42-dcdb-458c-a5f3-6a5fb416ab3f tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b932e8b0>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:49.774539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 15/21] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:49 2022] GET /compute/v2.1/os-volumes/f4524826-887f-40fa-a446-4154bf607eeb => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:12:49.811466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fc8a3ead-e458-40e7-bf80-2d70e8142046 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:49.812759 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-fc8a3ead-e458-40e7-bf80-2d70e8142046 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:12:49.827586 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d594de42-dcdb-458c-a5f3-6a5fb416ab3f tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6" status: 200 len: 287 microversion: 2.1 time: 0.078054 May 17 18:12:49.828386 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 7/22] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 17 18:12:49 2022] GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:12:49.843393 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1b3b9b7e-cd7c-4375-add3-f234dbce6340 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b932ef70>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:50.006626 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1b3b9b7e-cd7c-4375-add3-f234dbce6340 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6" status: 202 len: 0 microversion: 2.1 time: 0.168941 May 17 18:12:50.010771 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 8/23] 10.222.0.25 () {58 vars in 1253 bytes} [Tue May 17 18:12:49 2022] DELETE /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:12:50.017246 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2bf1ecbe-fdaf-4a06-80a3-0e5e830379a0 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b82cb670>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:50.100724 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2bf1ecbe-fdaf-4a06-80a3-0e5e830379a0 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6" status: 200 len: 286 microversion: 2.1 time: 0.087626 May 17 18:12:50.102329 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 9/24] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 17 18:12:50 2022] GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:12:50.271903 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-fc8a3ead-e458-40e7-bf80-2d70e8142046 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:12:50.281277 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-fc8a3ead-e458-40e7-bf80-2d70e8142046 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1215 microversion: 2.1 time: 0.474615 May 17 18:12:50.282816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 16/25] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:12:49 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1215 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:12:51.114421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2ee4e986-4bd8-423a-816d-08029a127363 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b932eee0>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:51.162673 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-2ee4e986-4bd8-423a-816d-08029a127363 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] HTTP exception thrown: Snapshot ba211540-3a68-4b35-9295-f951e0f5b3e6 could not be found. May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2ee4e986-4bd8-423a-816d-08029a127363 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Request method failure captured: May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6 HTTP/1.1 May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WY8o5irw1OQFXKc0FCl7jbNH_iv_IIsBiCRYGlDUQE6QfN6ot-tWITGwSdHFLz57mZtCht6CmVmxQvtpKe4dDAJ-MifPETv1YmZ035Q4EZsRIHhq1qCfKL4gi5zOt24RaGrU4br50xCm3cOfEkTQakvFbHuVqOqiHGeeHTjFuQpPI May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 4c4fcce854e14091939e4f379f438762 May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:12:51.167722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c4fcce854e14091939e4f379f438762"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c4fcce854e14091939e4f379f438762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c4fcce854e14091939e4f379f438762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c4fcce854e14091939e4f379f438762", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 4c4fcce854e14091939e4f379f438762 May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-VolumesSnapshotsTestJSON-1470715190-project May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c2b0f1d86c5a4cdeb5b0f9da35dcae8f May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1470715190-project May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Snapshot ba211540-3a68-4b35-9295-f951e0f5b3e6 could not be found. May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': 'ba211540-3a68-4b35-9295-f951e0f5b3e6'} May 17 18:12:51.168996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ba211540-3a68-4b35-9295-f951e0f5b3e6 could not be found. (HTTP 404) (Request-ID: req-56d47b9d-100e-4570-91aa-8ca511417ad4) May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:51.169674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:12:51.170543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ba211540-3a68-4b35-9295-f951e0f5b3e6 could not be found. May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 17 18:12:51.171473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ba211540-3a68-4b35-9295-f951e0f5b3e6 could not be found. May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ba211540-3a68-4b35-9295-f951e0f5b3e6 could not be found. May 17 18:12:51.172425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:51.187135 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2ee4e986-4bd8-423a-816d-08029a127363 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Returning 404 to user: Snapshot ba211540-3a68-4b35-9295-f951e0f5b3e6 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:12:51.190118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2ee4e986-4bd8-423a-816d-08029a127363 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6" status: 404 len: 111 microversion: 2.1 time: 0.080763 May 17 18:12:51.197968 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 10/26] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 17 18:12:51 2022] GET /compute/v2.1/os-snapshots/ba211540-3a68-4b35-9295-f951e0f5b3e6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:12:51.203943 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-304dfb11-5f6a-4582-b854-49d95f324882 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b9bbd8b0>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:51.302035 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a157de70-25c5-4ff8-993b-3aa0ef2fdc41 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:51.303497 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a157de70-25c5-4ff8-993b-3aa0ef2fdc41 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:12:51.341899 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a157de70-25c5-4ff8-993b-3aa0ef2fdc41 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:12:51.343631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a157de70-25c5-4ff8-993b-3aa0ef2fdc41 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:12:51.345047 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a157de70-25c5-4ff8-993b-3aa0ef2fdc41 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:12:51.346241 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a157de70-25c5-4ff8-993b-3aa0ef2fdc41 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:12:51.371184 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-304dfb11-5f6a-4582-b854-49d95f324882 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd" status: 202 len: 0 microversion: 2.1 time: 0.171529 May 17 18:12:51.375443 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 17/27] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 17 18:12:51 2022] DELETE /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:12:51.388104 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-23687c2a-010d-40b1-bd87-520bda3611e4 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b9bbde50>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:51.519644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-23687c2a-010d-40b1-bd87-520bda3611e4 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd" status: 200 len: 345 microversion: 2.1 time: 0.138457 May 17 18:12:51.522326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 18/28] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:51 2022] GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd => generated 345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:51.896382 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-98b8c86d-da33-471d-889d-fc75c54d5265 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: .version_select at 0x7f74b9b534c0>, body: {"keypair": {"name": "tempest-keypair-530647478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1M/0yIEiRv77USo+e+2yaN94QWP+WuHbjUCf1q5O6CqZTT2ft5ZSASBb4vvVgImjTLRdR5ch7KkanS5UyRM06GF9AkXDPORtPPAmSJLa5MOCgTYXpvfcAOvXBGCdcX8A=="}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:12:51.988286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-98b8c86d-da33-471d-889d-fc75c54d5265 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:12:52.002027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-98b8c86d-da33-471d-889d-fc75c54d5265 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for user c7b641ce301a4b7685f0f70d7ac4a5d3 and project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:12:52.151984 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-98b8c86d-da33-471d-889d-fc75c54d5265 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.433224 May 17 18:12:52.153318 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 19/29] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 17 18:12:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:12:52.533459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a157de70-25c5-4ff8-993b-3aa0ef2fdc41 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:12:52.534746 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-abbfcc4e-4793-4efc-8211-e4721c3fb4e9 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b9b15ee0>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:52.582563 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a157de70-25c5-4ff8-993b-3aa0ef2fdc41 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1267 microversion: 2.1 time: 1.285845 May 17 18:12:52.596016 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 11/30] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:12:51 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1267 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-abbfcc4e-4793-4efc-8211-e4721c3fb4e9 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] HTTP exception thrown: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-abbfcc4e-4793-4efc-8211-e4721c3fb4e9 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Request method failure captured: May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd HTTP/1.1 May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WY8o5irw1OQFXKc0FCl7jbNH_iv_IIsBiCRYGlDUQE6QfN6ot-tWITGwSdHFLz57mZtCht6CmVmxQvtpKe4dDAJ-MifPETv1YmZ035Q4EZsRIHhq1qCfKL4gi5zOt24RaGrU4br50xCm3cOfEkTQakvFbHuVqOqiHGeeHTjFuQpPI May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 4c4fcce854e14091939e4f379f438762 May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:12:52.596398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c4fcce854e14091939e4f379f438762"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c4fcce854e14091939e4f379f438762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c4fcce854e14091939e4f379f438762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c4fcce854e14091939e4f379f438762", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 4c4fcce854e14091939e4f379f438762 May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-VolumesSnapshotsTestJSON-1470715190-project May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c2b0f1d86c5a4cdeb5b0f9da35dcae8f May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1470715190-project May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '15f9e489-44b5-498f-ba0e-d805900332cd'} May 17 18:12:52.597486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. (HTTP 404) (Request-ID: req-73e55d3e-dc5b-43c6-9905-a74bbbc5ef86) May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:52.598149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:12:52.599660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 18:12:52.600677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-abbfcc4e-4793-4efc-8211-e4721c3fb4e9 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Returning 404 to user: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-abbfcc4e-4793-4efc-8211-e4721c3fb4e9 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd" status: 404 len: 109 microversion: 2.1 time: 0.059907 May 17 18:12:52.601581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 20/31] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:52 2022] GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 18:12:52.610101 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-06811238-958d-4084-9f43-8f93b9cc1f86 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b823af70>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:52.654545 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-06811238-958d-4084-9f43-8f93b9cc1f86 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] HTTP exception thrown: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-06811238-958d-4084-9f43-8f93b9cc1f86 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Request method failure captured: May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: DELETE /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd HTTP/1.1 May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WY8o5irw1OQFXKc0FCl7jbNH_iv_IIsBiCRYGlDUQE6QfN6ot-tWITGwSdHFLz57mZtCht6CmVmxQvtpKe4dDAJ-MifPETv1YmZ035Q4EZsRIHhq1qCfKL4gi5zOt24RaGrU4br50xCm3cOfEkTQakvFbHuVqOqiHGeeHTjFuQpPI May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 4c4fcce854e14091939e4f379f438762 May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:12:52.657419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c4fcce854e14091939e4f379f438762"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c4fcce854e14091939e4f379f438762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c4fcce854e14091939e4f379f438762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c4fcce854e14091939e4f379f438762", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 4c4fcce854e14091939e4f379f438762 May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-VolumesSnapshotsTestJSON-1470715190-project May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c2b0f1d86c5a4cdeb5b0f9da35dcae8f May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1470715190-project May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '15f9e489-44b5-498f-ba0e-d805900332cd'} May 17 18:12:52.658824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. (HTTP 404) (Request-ID: req-fa1fe0ee-e458-47b4-854f-c57147660810) May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:52.659498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:12:52.660612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 18:12:52.661739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.662880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:12:52.664239 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-06811238-958d-4084-9f43-8f93b9cc1f86 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Returning 404 to user: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:12:52.665586 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-06811238-958d-4084-9f43-8f93b9cc1f86 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd" status: 404 len: 109 microversion: 2.1 time: 0.059496 May 17 18:12:52.666958 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 12/32] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 17 18:12:52 2022] DELETE /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:12:52.675125 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6b3d3a1b-da11-482c-861b-d9bfa3943104 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Calling method '.version_select at 0x7f74b92cf160>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:52.739984 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-6b3d3a1b-da11-482c-861b-d9bfa3943104 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] HTTP exception thrown: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6b3d3a1b-da11-482c-861b-d9bfa3943104 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Request method failure captured: May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd HTTP/1.1 May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WY8o5irw1OQFXKc0FCl7jbNH_iv_IIsBiCRYGlDUQE6QfN6ot-tWITGwSdHFLz57mZtCht6CmVmxQvtpKe4dDAJ-MifPETv1YmZ035Q4EZsRIHhq1qCfKL4gi5zOt24RaGrU4br50xCm3cOfEkTQakvFbHuVqOqiHGeeHTjFuQpPI May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 4c4fcce854e14091939e4f379f438762 May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:12:52.742002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c4fcce854e14091939e4f379f438762"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c4fcce854e14091939e4f379f438762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c4fcce854e14091939e4f379f438762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c4fcce854e14091939e4f379f438762", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 4c4fcce854e14091939e4f379f438762 May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1470715190 May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-VolumesSnapshotsTestJSON-1470715190-project May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c2b0f1d86c5a4cdeb5b0f9da35dcae8f May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1470715190-project May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '15f9e489-44b5-498f-ba0e-d805900332cd'} May 17 18:12:52.743291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. (HTTP 404) (Request-ID: req-8d03183b-7eab-45c4-8739-e592941698a7) May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:52.744001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:12:52.745109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 18:12:52.746150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. May 17 18:12:52.747383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:12:52.748856 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6b3d3a1b-da11-482c-861b-d9bfa3943104 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] Returning 404 to user: Volume 15f9e489-44b5-498f-ba0e-d805900332cd could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:12:52.749717 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6b3d3a1b-da11-482c-861b-d9bfa3943104 tempest-VolumesSnapshotsTestJSON-1470715190 tempest-VolumesSnapshotsTestJSON-1470715190-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd" status: 404 len: 109 microversion: 2.1 time: 0.078447 May 17 18:12:52.750284 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 21/33] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:12:52 2022] GET /compute/v2.1/os-volumes/15f9e489-44b5-498f-ba0e-d805900332cd => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:12:53.604236 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0c44e4b2-78c5-4094-89b7-0cf05b314e5f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:53.605247 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0c44e4b2-78c5-4094-89b7-0cf05b314e5f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:12:53.613147 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0c44e4b2-78c5-4094-89b7-0cf05b314e5f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:12:53.616791 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0c44e4b2-78c5-4094-89b7-0cf05b314e5f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:12:53.623289 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0c44e4b2-78c5-4094-89b7-0cf05b314e5f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:12:53.627180 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0c44e4b2-78c5-4094-89b7-0cf05b314e5f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:12:54.001907 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0c44e4b2-78c5-4094-89b7-0cf05b314e5f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:12:54.009751 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0c44e4b2-78c5-4094-89b7-0cf05b314e5f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1273 microversion: 2.1 time: 0.409900 May 17 18:12:54.014659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 13/34] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:12:53 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1273 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:12:55.032421 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5e1b457d-3a07-4969-bb2b-015846bc8ca4 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:55.033909 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5e1b457d-3a07-4969-bb2b-015846bc8ca4 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:12:55.055108 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5e1b457d-3a07-4969-bb2b-015846bc8ca4 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:12:55.056064 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5e1b457d-3a07-4969-bb2b-015846bc8ca4 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:12:55.057770 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5e1b457d-3a07-4969-bb2b-015846bc8ca4 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:12:55.065049 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5e1b457d-3a07-4969-bb2b-015846bc8ca4 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:12:55.826771 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5e1b457d-3a07-4969-bb2b-015846bc8ca4 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:12:55.877669 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5e1b457d-3a07-4969-bb2b-015846bc8ca4 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1273 microversion: 2.1 time: 0.847386 May 17 18:12:55.890256 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 22/35] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:12:55 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1273 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:12:56.917203 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-720c90ec-aa6a-46a1-9199-a8fb2af254da tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:12:56.918718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-720c90ec-aa6a-46a1-9199-a8fb2af254da tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:12:56.929122 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-720c90ec-aa6a-46a1-9199-a8fb2af254da tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:12:56.935618 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-720c90ec-aa6a-46a1-9199-a8fb2af254da tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:12:56.952824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-720c90ec-aa6a-46a1-9199-a8fb2af254da tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:12:56.953624 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-720c90ec-aa6a-46a1-9199-a8fb2af254da tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:00.158307 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-720c90ec-aa6a-46a1-9199-a8fb2af254da tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:00.176235 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-720c90ec-aa6a-46a1-9199-a8fb2af254da tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 3.273535 May 17 18:13:00.182451 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 14/36] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:12:56 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 3280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:01.200588 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ad2861ff-c22e-4899-9b06-84d07fefe22a tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:01.202050 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ad2861ff-c22e-4899-9b06-84d07fefe22a tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:01.235134 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad2861ff-c22e-4899-9b06-84d07fefe22a tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:01.237392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad2861ff-c22e-4899-9b06-84d07fefe22a tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:01.243521 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad2861ff-c22e-4899-9b06-84d07fefe22a tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:01.245011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad2861ff-c22e-4899-9b06-84d07fefe22a tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:02.360526 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-685436431", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2312f304-fc95-4d23-b522-6c0433564246"}], "security_groups": [{"name": "tempest-securitygroup--27057030"}], "key_name": "tempest-keypair-881682926", "user_data": "}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:03.460070 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ad2861ff-c22e-4899-9b06-84d07fefe22a tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:03.474814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ad2861ff-c22e-4899-9b06-84d07fefe22a tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 2.279884 May 17 18:13:03.484325 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 23/37] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:01 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:03.523640 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] validate_networks() for [('2312f304-fc95-4d23-b522-6c0433564246', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:13:03.729859 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-80b3a60d-4812-49fa-a615-995800c73d68 req-33a6a526-5044-4761-b0e7-732ee26a4709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87868251-b09f-4394-86e6-728fb6e97a61", "tag": "2cbb7559-cda8-4005-8189-124ea3d219b0"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:03.814224 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-80b3a60d-4812-49fa-a615-995800c73d68 req-33a6a526-5044-4761-b0e7-732ee26a4709 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:03.814803 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-80b3a60d-4812-49fa-a615-995800c73d68 req-33a6a526-5044-4761-b0e7-732ee26a4709 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:03.906556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-80b3a60d-4812-49fa-a615-995800c73d68 req-33a6a526-5044-4761-b0e7-732ee26a4709 service nova] Creating event network-changed:2cbb7559-cda8-4005-8189-124ea3d219b0 for instance 87868251-b09f-4394-86e6-728fb6e97a61 on hv-cinder-84130 May 17 18:13:03.907734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-80b3a60d-4812-49fa-a615-995800c73d68 req-33a6a526-5044-4761-b0e7-732ee26a4709 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117021) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 18:13:03.928508 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-67293b82-8802-4e6d-91d2-ad7d2dbf6c22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:03.929996 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-67293b82-8802-4e6d-91d2-ad7d2dbf6c22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:03.949415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-67293b82-8802-4e6d-91d2-ad7d2dbf6c22 None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:03.949879 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-67293b82-8802-4e6d-91d2-ad7d2dbf6c22 None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:03.983006 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.compute.rpcapi [None req-67293b82-8802-4e6d-91d2-ad7d2dbf6c22 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 18:13:03.983919 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-67293b82-8802-4e6d-91d2-ad7d2dbf6c22 None None] Releasing lock "compute-rpcapi-router" {{(pid=117021) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 18:13:04.047318 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-67293b82-8802-4e6d-91d2-ad7d2dbf6c22 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.559717 May 17 18:13:04.049440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 24/38] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:04.062372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-290142947", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc022e51-2bed-4b09-b828-c8708bb8de4d"}], "security_groups": [{"name": "tempest-securitygroup--305905125"}], "key_name": "tempest-keypair-530647478", "user_data": "}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:05.191492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.network.neutron [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] validate_networks() for [('bc022e51-2bed-4b09-b828-c8708bb8de4d', None, None, None, None, None)] {{(pid=117021) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:13:05.536263 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:13:05.541552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:13:05.542234 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:13:05.542856 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:13:05.543440 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:13:05.575478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:05.583401 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:05.584665 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:05.589886 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:05.649276 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Getting quotas for project 492389142d804ad392267cb4a728008d. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:13:05.663505 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Getting quotas for user 8ba97b67ecf64476a630fd3667d617fb and project 492389142d804ad392267cb4a728008d. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:13:05.685565 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:13:05.689502 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:13:05.806034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fb3d0fd9-7e42-4133-91d3-10c455c7fcf1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 3.450240 May 17 18:13:05.806964 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 15/39] 10.222.0.25 () {62 vars in 1187 bytes} [Tue May 17 18:13:02 2022] POST /compute/v2.1/servers => generated 400 bytes in 3452 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 17 18:13:05.820246 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d26fc8a5-d897-43f8-9c81-2014f631f796 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:05.824811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d26fc8a5-d897-43f8-9c81-2014f631f796 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:05.836638 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d26fc8a5-d897-43f8-9c81-2014f631f796 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:05.840332 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d26fc8a5-d897-43f8-9c81-2014f631f796 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:05.841303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d26fc8a5-d897-43f8-9c81-2014f631f796 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:05.842994 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d26fc8a5-d897-43f8-9c81-2014f631f796 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:06.547181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d26fc8a5-d897-43f8-9c81-2014f631f796 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:06.565322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d26fc8a5-d897-43f8-9c81-2014f631f796 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 0.757267 May 17 18:13:06.565932 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 16/40] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:05 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:07.359620 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-11062c9a-c3e3-47a8-9028-03c17c2a6254 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'create', calling method: .version_select at 0x7f74b818f820>, body: {"keypair": {"name": "tempest-keypair-1302056829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8pcDGtGFNiVf9EDarL6VGFrg6/HTiSQV9EGRwbTd5DTswbqtmMYXitxJjVv3oAuRnUGgN2LoOhoprv69iB2Vx12xZLuWcoj1OqtFfRv358kMg/iQAga4GYn7vDtKYfKw=="}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:07.398773 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-11062c9a-c3e3-47a8-9028-03c17c2a6254 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Getting quotas for project c087a662f09843faa87b942c9462ec67. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:13:07.413219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-11062c9a-c3e3-47a8-9028-03c17c2a6254 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Getting quotas for user 17c2097983df461eb7c23bc0ed7b7520 and project c087a662f09843faa87b942c9462ec67. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:13:07.466492 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-11062c9a-c3e3-47a8-9028-03c17c2a6254 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.899504 May 17 18:13:07.467413 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 17/41] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 17 18:13:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:07.472386 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-731265e5-f531-43c5-8d6a-58bade08e761 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:07.474504 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-731265e5-f531-43c5-8d6a-58bade08e761 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:07.582014 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-731265e5-f531-43c5-8d6a-58bade08e761 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:07.608145 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-731265e5-f531-43c5-8d6a-58bade08e761 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:07.615872 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-731265e5-f531-43c5-8d6a-58bade08e761 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:07.617445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-731265e5-f531-43c5-8d6a-58bade08e761 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1280 microversion: 2.20 time: 0.148839 May 17 18:13:07.625221 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 18/42] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:07 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1280 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:07.674135 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Flavor limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:13:07.674745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Image limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:13:07.675343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Flavor pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:13:07.675868 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Image pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:13:07.676387 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:13:07.698077 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:07.702000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:07.705789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:07.708403 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:07.786358 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2140766719", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:07.797509 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:13:07.812864 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for user c7b641ce301a4b7685f0f70d7ac4a5d3 and project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:13:07.857859 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Going to run 1 instances... {{(pid=117021) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:13:07.871484 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:13:07.914866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] validate_networks() for [('10e6d493-7166-404c-8c80-451fd67dd6e6', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:13:08.059062 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1abe23ad-b26c-42c4-aadf-aa9e8b7a181c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.007457 May 17 18:13:08.066453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 25/43] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:13:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 4016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:13:08.074853 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-119206c9-205d-49ca-8b28-4ec8f28ffa69 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:08.075487 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-119206c9-205d-49ca-8b28-4ec8f28ffa69 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:08.124078 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-119206c9-205d-49ca-8b28-4ec8f28ffa69 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:08.124551 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-119206c9-205d-49ca-8b28-4ec8f28ffa69 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:08.125362 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-119206c9-205d-49ca-8b28-4ec8f28ffa69 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:08.125813 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-119206c9-205d-49ca-8b28-4ec8f28ffa69 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:09.129555 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-119206c9-205d-49ca-8b28-4ec8f28ffa69 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:09.140439 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-119206c9-205d-49ca-8b28-4ec8f28ffa69 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 1.068215 May 17 18:13:09.141100 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 26/44] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:08 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:09.178313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-01159fc5-eb54-4e60-a95e-eeba0c88c682 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:09.179319 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-01159fc5-eb54-4e60-a95e-eeba0c88c682 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:09.394267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-01159fc5-eb54-4e60-a95e-eeba0c88c682 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:09.405299 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-01159fc5-eb54-4e60-a95e-eeba0c88c682 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1240 microversion: 2.1 time: 0.262899 May 17 18:13:09.407212 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 27/45] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:09 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1240 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:09.430299 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a76e4db7-b2d1-4178-9054-49a7a29a5a2c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:09.432396 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a76e4db7-b2d1-4178-9054-49a7a29a5a2c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:09.451641 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a76e4db7-b2d1-4178-9054-49a7a29a5a2c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:09.452403 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a76e4db7-b2d1-4178-9054-49a7a29a5a2c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:09.455766 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a76e4db7-b2d1-4178-9054-49a7a29a5a2c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:09.457186 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a76e4db7-b2d1-4178-9054-49a7a29a5a2c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:09.798733 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a76e4db7-b2d1-4178-9054-49a7a29a5a2c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:09.802060 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:13:09.803151 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:13:09.804160 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:13:09.804773 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:13:09.805395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:13:09.809260 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a76e4db7-b2d1-4178-9054-49a7a29a5a2c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:09.812300 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a76e4db7-b2d1-4178-9054-49a7a29a5a2c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:09.817691 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:09.818371 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:09.819307 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a76e4db7-b2d1-4178-9054-49a7a29a5a2c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1332 microversion: 2.20 time: 0.410614 May 17 18:13:09.819568 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:09.820047 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 28/46] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:09 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1332 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:09.820609 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:09.845567 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Getting quotas for project e32e7b68f0464827afc5ed835cee1d15. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:13:09.859903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Getting quotas for user 62a9f27a865b468989f672a05dbab350 and project e32e7b68f0464827afc5ed835cee1d15. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:13:09.877079 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:13:09.887645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:13:09.985281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d733e837-eec1-47dc-b2a4-18fb8b5ee610 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.355671 May 17 18:13:09.986003 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 19/47] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:13:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:13:09.997963 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fa743af2-e148-486c-a211-61e6e8b5e64e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:09.999707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-fa743af2-e148-486c-a211-61e6e8b5e64e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:10.112778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-fa743af2-e148-486c-a211-61e6e8b5e64e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:10.121022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-fa743af2-e148-486c-a211-61e6e8b5e64e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1222 microversion: 2.1 time: 0.128947 May 17 18:13:10.123066 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 29/48] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:09 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:10.163497 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f4d4f796-af52-48c3-968f-dd36d6ce345e tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:10.167927 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f4d4f796-af52-48c3-968f-dd36d6ce345e tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:10.185429 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f4d4f796-af52-48c3-968f-dd36d6ce345e tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:10.187416 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f4d4f796-af52-48c3-968f-dd36d6ce345e tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:10.189114 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f4d4f796-af52-48c3-968f-dd36d6ce345e tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:10.190144 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f4d4f796-af52-48c3-968f-dd36d6ce345e tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:10.395569 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-655438474", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:10.490744 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f4d4f796-af52-48c3-968f-dd36d6ce345e tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:10.500338 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f4d4f796-af52-48c3-968f-dd36d6ce345e tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 0.345580 May 17 18:13:10.504434 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 20/49] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:10 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:10.515998 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-35b58bf0-4c0b-4704-bb7f-657b4e9bfb68 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:10.524001 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-35b58bf0-4c0b-4704-bb7f-657b4e9bfb68 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:10.538318 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.network.neutron [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] validate_networks() for [('10e6d493-7166-404c-8c80-451fd67dd6e6', None, None, None, None, None)] {{(pid=117021) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:13:10.545989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35b58bf0-4c0b-4704-bb7f-657b4e9bfb68 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:10.546891 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35b58bf0-4c0b-4704-bb7f-657b4e9bfb68 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:10.548130 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35b58bf0-4c0b-4704-bb7f-657b4e9bfb68 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:10.555526 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35b58bf0-4c0b-4704-bb7f-657b4e9bfb68 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:10.756038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-35b58bf0-4c0b-4704-bb7f-657b4e9bfb68 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:10.771097 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-35b58bf0-4c0b-4704-bb7f-657b4e9bfb68 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1244 microversion: 2.1 time: 0.262404 May 17 18:13:10.774121 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 21/50] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:10 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1244 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:10.838162 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d8f1455a-2125-4e30-9f34-e4ec0351120c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:10.839770 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d8f1455a-2125-4e30-9f34-e4ec0351120c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:10.855579 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d8f1455a-2125-4e30-9f34-e4ec0351120c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:10.856042 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d8f1455a-2125-4e30-9f34-e4ec0351120c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:10.861172 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d8f1455a-2125-4e30-9f34-e4ec0351120c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:10.861639 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d8f1455a-2125-4e30-9f34-e4ec0351120c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:10.971524 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d8f1455a-2125-4e30-9f34-e4ec0351120c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:10.988742 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d8f1455a-2125-4e30-9f34-e4ec0351120c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:10.992789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d8f1455a-2125-4e30-9f34-e4ec0351120c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:10.994612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d8f1455a-2125-4e30-9f34-e4ec0351120c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1332 microversion: 2.20 time: 0.161255 May 17 18:13:11.011245 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 22/51] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:10 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1332 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:11.392357 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Flavor limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:13:11.392770 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Image limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:13:11.394375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Flavor pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:13:11.394996 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Image pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:13:11.395752 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:13:11.407830 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:11.408541 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:11.411788 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:11.412740 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:11.468850 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Getting quotas for project e32e7b68f0464827afc5ed835cee1d15. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:13:11.479223 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Getting quotas for user 62a9f27a865b468989f672a05dbab350 and project e32e7b68f0464827afc5ed835cee1d15. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:13:11.497884 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Going to run 1 instances... {{(pid=117021) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:13:11.501862 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:13:11.523164 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-cc0299f4-29d0-42e0-a88c-22b942abb024 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:11.523802 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-cc0299f4-29d0-42e0-a88c-22b942abb024 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:11.539490 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc0299f4-29d0-42e0-a88c-22b942abb024 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:11.540097 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc0299f4-29d0-42e0-a88c-22b942abb024 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:11.541245 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc0299f4-29d0-42e0-a88c-22b942abb024 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:11.541695 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc0299f4-29d0-42e0-a88c-22b942abb024 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:11.590965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-29bd4f90-03b9-4654-a0f5-31bc9da5f181 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.204205 May 17 18:13:11.596684 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 30/52] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:13:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:13:11.601954 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1415805003", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0e67a0c-2bb4-4c55-8fbd-692a7edee27d"}], "security_groups": [{"name": "tempest-securitygroup--1830576836"}], "key_name": "tempest-keypair-1302056829", "user_data": "}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:11.829375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.network.neutron [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] validate_networks() for [('b0e67a0c-2bb4-4c55-8fbd-692a7edee27d', None, None, None, None, None)] {{(pid=117021) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:13:12.239839 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-cc0299f4-29d0-42e0-a88c-22b942abb024 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:12.259369 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-cc0299f4-29d0-42e0-a88c-22b942abb024 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 0.743216 May 17 18:13:12.276359 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 23/53] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:11 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:12.297009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3b6426b5-430c-4bd6-a985-1052c05ea26c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:12.300918 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3b6426b5-430c-4bd6-a985-1052c05ea26c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:12.452534 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3b6426b5-430c-4bd6-a985-1052c05ea26c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:12.473757 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3b6426b5-430c-4bd6-a985-1052c05ea26c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1221 microversion: 2.1 time: 0.195979 May 17 18:13:12.475225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 24/54] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:12 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1221 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:12.488455 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5c0e0a59-a5ec-4e3e-9d6a-01b31594a655 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:12.493944 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5c0e0a59-a5ec-4e3e-9d6a-01b31594a655 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:12.511249 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c0e0a59-a5ec-4e3e-9d6a-01b31594a655 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:12.514084 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c0e0a59-a5ec-4e3e-9d6a-01b31594a655 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:12.516273 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c0e0a59-a5ec-4e3e-9d6a-01b31594a655 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:12.519262 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c0e0a59-a5ec-4e3e-9d6a-01b31594a655 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:12.737654 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5c0e0a59-a5ec-4e3e-9d6a-01b31594a655 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:12.781242 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5c0e0a59-a5ec-4e3e-9d6a-01b31594a655 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1292 microversion: 2.1 time: 0.289582 May 17 18:13:12.784639 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 25/55] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:12 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1292 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:12.794809 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a23c2477-a1ec-4485-a0ba-43fc63bd4682 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:12.797608 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a23c2477-a1ec-4485-a0ba-43fc63bd4682 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:12.807243 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a23c2477-a1ec-4485-a0ba-43fc63bd4682 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:12.809976 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a23c2477-a1ec-4485-a0ba-43fc63bd4682 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:12.811315 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a23c2477-a1ec-4485-a0ba-43fc63bd4682 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:12.812485 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a23c2477-a1ec-4485-a0ba-43fc63bd4682 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:12.916000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Flavor limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:13:12.916482 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Image limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:13:12.917017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Flavor pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:13:12.917419 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Image pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:13:12.920315 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:13:12.948093 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:12.948682 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:12.960321 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:12.960935 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:13.027621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Getting quotas for project c087a662f09843faa87b942c9462ec67. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:13:13.043595 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a23c2477-a1ec-4485-a0ba-43fc63bd4682 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:13.048199 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Getting quotas for user 17c2097983df461eb7c23bc0ed7b7520 and project c087a662f09843faa87b942c9462ec67. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:13:13.068172 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a23c2477-a1ec-4485-a0ba-43fc63bd4682 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:13.072095 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a23c2477-a1ec-4485-a0ba-43fc63bd4682 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:13.075427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a23c2477-a1ec-4485-a0ba-43fc63bd4682 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1340 microversion: 2.20 time: 0.288273 May 17 18:13:13.093842 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 26/56] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:12 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1340 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:13.096345 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Going to run 1 instances... {{(pid=117021) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:13:13.101982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:13:13.255593 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-66bb577f-3e2d-40bc-b0db-6643a2c5eb73 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.657754 May 17 18:13:13.256258 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 31/57] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:13:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:13:13.283982 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2cf50410-613c-4b83-bbc5-e61be0daca81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:13.285311 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2cf50410-613c-4b83-bbc5-e61be0daca81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:13.341633 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-be766549-8118-4ec4-b707-bc8498723ba5 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:13.342261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-be766549-8118-4ec4-b707-bc8498723ba5 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:13.388770 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2cf50410-613c-4b83-bbc5-e61be0daca81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:13.389277 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-be766549-8118-4ec4-b707-bc8498723ba5 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:13.389938 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-be766549-8118-4ec4-b707-bc8498723ba5 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:13.392355 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-be766549-8118-4ec4-b707-bc8498723ba5 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:13.392968 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-be766549-8118-4ec4-b707-bc8498723ba5 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:13.397434 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2cf50410-613c-4b83-bbc5-e61be0daca81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1238 microversion: 2.1 time: 0.134073 May 17 18:13:13.400962 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 27/58] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:13 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1238 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:13.497342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c39bdf20-baaa-4cac-9689-8684a875f6b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:13.503696 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c39bdf20-baaa-4cac-9689-8684a875f6b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:13.529131 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c39bdf20-baaa-4cac-9689-8684a875f6b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:13.529843 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c39bdf20-baaa-4cac-9689-8684a875f6b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:13.536182 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c39bdf20-baaa-4cac-9689-8684a875f6b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:13.540869 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c39bdf20-baaa-4cac-9689-8684a875f6b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:13.957734 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c39bdf20-baaa-4cac-9689-8684a875f6b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:13.979774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c39bdf20-baaa-4cac-9689-8684a875f6b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1217 microversion: 2.1 time: 0.490082 May 17 18:13:13.981217 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 28/59] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:13 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1217 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:14.001270 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d417bed7-2ca5-45ed-b5b7-ab4d9827053d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:14.003045 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d417bed7-2ca5-45ed-b5b7-ab4d9827053d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:14.021575 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d417bed7-2ca5-45ed-b5b7-ab4d9827053d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:14.026938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d417bed7-2ca5-45ed-b5b7-ab4d9827053d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:14.027895 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d417bed7-2ca5-45ed-b5b7-ab4d9827053d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:14.029529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d417bed7-2ca5-45ed-b5b7-ab4d9827053d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:14.257736 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-be766549-8118-4ec4-b707-bc8498723ba5 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:14.268466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-be766549-8118-4ec4-b707-bc8498723ba5 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 0.954980 May 17 18:13:14.281218 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 32/60] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:13 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:14.286644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7b25c8d7-fd77-4546-b1c7-748749da9438 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:14.287559 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7b25c8d7-fd77-4546-b1c7-748749da9438 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:14.291811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d417bed7-2ca5-45ed-b5b7-ab4d9827053d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:14.295987 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7b25c8d7-fd77-4546-b1c7-748749da9438 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:14.296657 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7b25c8d7-fd77-4546-b1c7-748749da9438 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:14.298224 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7b25c8d7-fd77-4546-b1c7-748749da9438 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:14.298905 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7b25c8d7-fd77-4546-b1c7-748749da9438 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:14.302187 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d417bed7-2ca5-45ed-b5b7-ab4d9827053d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1298 microversion: 2.1 time: 0.317555 May 17 18:13:14.312809 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 29/61] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:13 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1298 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:14.409635 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7b25c8d7-fd77-4546-b1c7-748749da9438 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:14.417010 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bcc9a581-ee53-49f6-a22a-1201bc8719c7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:14.417855 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-bcc9a581-ee53-49f6-a22a-1201bc8719c7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:14.430229 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7b25c8d7-fd77-4546-b1c7-748749da9438 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:14.430823 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bcc9a581-ee53-49f6-a22a-1201bc8719c7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:14.431551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bcc9a581-ee53-49f6-a22a-1201bc8719c7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:14.433110 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bcc9a581-ee53-49f6-a22a-1201bc8719c7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:14.433566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bcc9a581-ee53-49f6-a22a-1201bc8719c7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:14.435213 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7b25c8d7-fd77-4546-b1c7-748749da9438 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:14.439136 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7b25c8d7-fd77-4546-b1c7-748749da9438 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1338 microversion: 2.20 time: 0.153910 May 17 18:13:14.439875 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 33/62] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:14 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1338 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:14.546378 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-bcc9a581-ee53-49f6-a22a-1201bc8719c7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:14.563462 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-bcc9a581-ee53-49f6-a22a-1201bc8719c7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1234 microversion: 2.1 time: 0.149658 May 17 18:13:14.576474 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 30/63] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:14 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1234 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:14.998496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1108f5e8-515d-42da-b89e-e76d07352b7f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:14.999502 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1108f5e8-515d-42da-b89e-e76d07352b7f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:15.005715 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1108f5e8-515d-42da-b89e-e76d07352b7f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:15.006465 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1108f5e8-515d-42da-b89e-e76d07352b7f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:15.007518 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1108f5e8-515d-42da-b89e-e76d07352b7f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:15.008118 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1108f5e8-515d-42da-b89e-e76d07352b7f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:15.288399 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-92dd00b6-9f75-426e-b309-2a71c75cd6c8 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:15.289023 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-92dd00b6-9f75-426e-b309-2a71c75cd6c8 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:15.309425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-92dd00b6-9f75-426e-b309-2a71c75cd6c8 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:15.310091 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-92dd00b6-9f75-426e-b309-2a71c75cd6c8 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:15.310837 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-92dd00b6-9f75-426e-b309-2a71c75cd6c8 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:15.311281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-92dd00b6-9f75-426e-b309-2a71c75cd6c8 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:15.732354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1108f5e8-515d-42da-b89e-e76d07352b7f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:15.747586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1108f5e8-515d-42da-b89e-e76d07352b7f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1279 microversion: 2.1 time: 0.753943 May 17 18:13:15.751251 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 34/64] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:14 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1279 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:15.780293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a1394e6c-64f6-420e-82dd-32634e3e8313 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:15.781335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a1394e6c-64f6-420e-82dd-32634e3e8313 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:15.796230 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a1394e6c-64f6-420e-82dd-32634e3e8313 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:15.796696 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a1394e6c-64f6-420e-82dd-32634e3e8313 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:15.797560 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a1394e6c-64f6-420e-82dd-32634e3e8313 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:15.798014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a1394e6c-64f6-420e-82dd-32634e3e8313 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:16.241663 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-92dd00b6-9f75-426e-b309-2a71c75cd6c8 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:16.260321 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-92dd00b6-9f75-426e-b309-2a71c75cd6c8 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 0.975928 May 17 18:13:16.267558 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 31/65] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:15 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:16.276217 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9892d2e7-6929-4e57-bbb8-4888396ca0db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:16.278415 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9892d2e7-6929-4e57-bbb8-4888396ca0db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:16.288366 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9892d2e7-6929-4e57-bbb8-4888396ca0db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:16.289015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9892d2e7-6929-4e57-bbb8-4888396ca0db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:16.289801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9892d2e7-6929-4e57-bbb8-4888396ca0db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:16.292025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9892d2e7-6929-4e57-bbb8-4888396ca0db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:16.853170 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a1394e6c-64f6-420e-82dd-32634e3e8313 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:16.875914 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a1394e6c-64f6-420e-82dd-32634e3e8313 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 1.123373 May 17 18:13:16.879563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 35/66] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:15 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:16.901651 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f7127d54-638c-4b1b-ace4-7a10dd84de74 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:16.904510 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f7127d54-638c-4b1b-ace4-7a10dd84de74 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:16.913625 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7127d54-638c-4b1b-ace4-7a10dd84de74 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:16.915329 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7127d54-638c-4b1b-ace4-7a10dd84de74 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:16.918967 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7127d54-638c-4b1b-ace4-7a10dd84de74 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:16.919685 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7127d54-638c-4b1b-ace4-7a10dd84de74 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:16.984938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9892d2e7-6929-4e57-bbb8-4888396ca0db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:16.999617 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9892d2e7-6929-4e57-bbb8-4888396ca0db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:17.001668 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9892d2e7-6929-4e57-bbb8-4888396ca0db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:17.003075 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9892d2e7-6929-4e57-bbb8-4888396ca0db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.734270 May 17 18:13:17.014780 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 32/67] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:16 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:17.090898 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f7127d54-638c-4b1b-ace4-7a10dd84de74 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:17.098334 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f7127d54-638c-4b1b-ace4-7a10dd84de74 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1296 microversion: 2.1 time: 0.205961 May 17 18:13:17.111684 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 36/68] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:16 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1296 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:17.124512 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7763abab-f4bf-4ad4-ae8b-248b8e4292ab tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:17.125153 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7763abab-f4bf-4ad4-ae8b-248b8e4292ab tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:17.135890 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7763abab-f4bf-4ad4-ae8b-248b8e4292ab tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:17.136343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7763abab-f4bf-4ad4-ae8b-248b8e4292ab tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:17.137120 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7763abab-f4bf-4ad4-ae8b-248b8e4292ab tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:17.137707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7763abab-f4bf-4ad4-ae8b-248b8e4292ab tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:17.328301 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-18b040bf-2437-4efc-923a-519576d275eb req-93e58719-87ab-4757-8b92-218ba8e45b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87868251-b09f-4394-86e6-728fb6e97a61", "name": "network-vif-plugged", "status": "completed", "tag": "2cbb7559-cda8-4005-8189-124ea3d219b0"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:17.341688 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7763abab-f4bf-4ad4-ae8b-248b8e4292ab tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:17.349883 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7763abab-f4bf-4ad4-ae8b-248b8e4292ab tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1279 microversion: 2.1 time: 0.237035 May 17 18:13:17.354396 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-18b040bf-2437-4efc-923a-519576d275eb req-93e58719-87ab-4757-8b92-218ba8e45b7e service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:17.354695 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 37/69] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:17 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1279 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:17.355350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-18b040bf-2437-4efc-923a-519576d275eb req-93e58719-87ab-4757-8b92-218ba8e45b7e service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:17.364528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1d61f111-0a9e-4efc-86b8-8765e19c2922 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:17.365140 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1d61f111-0a9e-4efc-86b8-8765e19c2922 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:17.374713 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d61f111-0a9e-4efc-86b8-8765e19c2922 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:17.379187 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d61f111-0a9e-4efc-86b8-8765e19c2922 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:17.380222 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d61f111-0a9e-4efc-86b8-8765e19c2922 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:17.380828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d61f111-0a9e-4efc-86b8-8765e19c2922 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:17.406532 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-18b040bf-2437-4efc-923a-519576d275eb req-93e58719-87ab-4757-8b92-218ba8e45b7e service nova] Creating event network-vif-plugged:2cbb7559-cda8-4005-8189-124ea3d219b0 for instance 87868251-b09f-4394-86e6-728fb6e97a61 on hv-cinder-84130 May 17 18:13:17.408461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-18b040bf-2437-4efc-923a-519576d275eb req-93e58719-87ab-4757-8b92-218ba8e45b7e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117020) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 18:13:17.409901 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-666f18d1-12b9-4d9b-accd-8d984dabe60a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:17.415914 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-666f18d1-12b9-4d9b-accd-8d984dabe60a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:17.417344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-666f18d1-12b9-4d9b-accd-8d984dabe60a None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:17.418073 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-666f18d1-12b9-4d9b-accd-8d984dabe60a None None] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:17.438455 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.compute.rpcapi [None req-666f18d1-12b9-4d9b-accd-8d984dabe60a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 18:13:17.440281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-666f18d1-12b9-4d9b-accd-8d984dabe60a None None] Releasing lock "compute-rpcapi-router" {{(pid=117020) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 18:13:17.478792 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-666f18d1-12b9-4d9b-accd-8d984dabe60a None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.462618 May 17 18:13:17.483321 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 33/70] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:17.706917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1d61f111-0a9e-4efc-86b8-8765e19c2922 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:17.717201 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1d61f111-0a9e-4efc-86b8-8765e19c2922 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 0.361460 May 17 18:13:17.728478 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 38/71] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:17 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:17.897720 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a8acdb6a-cbc3-4ad2-a519-0a925eb3b4ff tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:17.898768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a8acdb6a-cbc3-4ad2-a519-0a925eb3b4ff tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:17.913789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8acdb6a-cbc3-4ad2-a519-0a925eb3b4ff tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:17.915558 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8acdb6a-cbc3-4ad2-a519-0a925eb3b4ff tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:17.916608 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8acdb6a-cbc3-4ad2-a519-0a925eb3b4ff tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:17.919731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8acdb6a-cbc3-4ad2-a519-0a925eb3b4ff tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:18.024736 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0bdf6297-ff2e-4e80-8df7-6012ba5e5e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:18.025641 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0bdf6297-ff2e-4e80-8df7-6012ba5e5e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:18.041526 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0bdf6297-ff2e-4e80-8df7-6012ba5e5e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:18.043585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0bdf6297-ff2e-4e80-8df7-6012ba5e5e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:18.045642 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0bdf6297-ff2e-4e80-8df7-6012ba5e5e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:18.046143 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0bdf6297-ff2e-4e80-8df7-6012ba5e5e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:18.433032 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a8acdb6a-cbc3-4ad2-a519-0a925eb3b4ff tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:18.442266 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0bdf6297-ff2e-4e80-8df7-6012ba5e5e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:18.453525 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a8acdb6a-cbc3-4ad2-a519-0a925eb3b4ff tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.560283 May 17 18:13:18.458125 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0bdf6297-ff2e-4e80-8df7-6012ba5e5e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:18.469308 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 34/72] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:17 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:18.474531 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-daf54945-0f5a-4a4d-aaef-0decdfa21660 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:18.476723 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0bdf6297-ff2e-4e80-8df7-6012ba5e5e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:18.478109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0bdf6297-ff2e-4e80-8df7-6012ba5e5e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.460626 May 17 18:13:18.479165 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 39/73] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:18 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:18.483460 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-daf54945-0f5a-4a4d-aaef-0decdfa21660 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:18.487976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c2955469-e2f8-446d-84ed-e54f59282a39 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:18.490712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c2955469-e2f8-446d-84ed-e54f59282a39 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:18.492498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-daf54945-0f5a-4a4d-aaef-0decdfa21660 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:18.495117 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-daf54945-0f5a-4a4d-aaef-0decdfa21660 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:18.496098 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-daf54945-0f5a-4a4d-aaef-0decdfa21660 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:18.497715 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-daf54945-0f5a-4a4d-aaef-0decdfa21660 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:18.503337 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2955469-e2f8-446d-84ed-e54f59282a39 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:18.503792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2955469-e2f8-446d-84ed-e54f59282a39 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:18.504675 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2955469-e2f8-446d-84ed-e54f59282a39 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:18.505021 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2955469-e2f8-446d-84ed-e54f59282a39 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:18.661480 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-daf54945-0f5a-4a4d-aaef-0decdfa21660 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:18.698459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-daf54945-0f5a-4a4d-aaef-0decdfa21660 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1296 microversion: 2.1 time: 0.225579 May 17 18:13:18.699510 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 35/74] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:18 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:18.757774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ab56e96a-12a3-4719-86fc-5e3454db8035 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:18.762315 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ab56e96a-12a3-4719-86fc-5e3454db8035 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:18.773911 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ab56e96a-12a3-4719-86fc-5e3454db8035 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:18.775589 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ab56e96a-12a3-4719-86fc-5e3454db8035 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:18.779538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ab56e96a-12a3-4719-86fc-5e3454db8035 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:18.784469 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ab56e96a-12a3-4719-86fc-5e3454db8035 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:19.005769 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c2955469-e2f8-446d-84ed-e54f59282a39 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:19.018449 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c2955469-e2f8-446d-84ed-e54f59282a39 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.537928 May 17 18:13:19.024017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 40/75] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:18 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:19.282034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ab56e96a-12a3-4719-86fc-5e3454db8035 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:19.293994 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ab56e96a-12a3-4719-86fc-5e3454db8035 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 0.549783 May 17 18:13:19.294495 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 36/76] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:18 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:19.480030 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-29e07830-714a-413e-abc1-0bc2d8dd192b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:19.480625 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-29e07830-714a-413e-abc1-0bc2d8dd192b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:19.496715 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-73f9ff2e-b8d9-4b22-9bde-8ed547fb7993 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:19.497324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-73f9ff2e-b8d9-4b22-9bde-8ed547fb7993 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:19.503596 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29e07830-714a-413e-abc1-0bc2d8dd192b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:19.504042 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29e07830-714a-413e-abc1-0bc2d8dd192b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:19.507074 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-73f9ff2e-b8d9-4b22-9bde-8ed547fb7993 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:19.508179 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29e07830-714a-413e-abc1-0bc2d8dd192b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:19.509299 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29e07830-714a-413e-abc1-0bc2d8dd192b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:19.510314 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-73f9ff2e-b8d9-4b22-9bde-8ed547fb7993 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:19.517561 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-73f9ff2e-b8d9-4b22-9bde-8ed547fb7993 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:19.524207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-73f9ff2e-b8d9-4b22-9bde-8ed547fb7993 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:20.223651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-73f9ff2e-b8d9-4b22-9bde-8ed547fb7993 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:20.232279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-73f9ff2e-b8d9-4b22-9bde-8ed547fb7993 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:20.237920 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-73f9ff2e-b8d9-4b22-9bde-8ed547fb7993 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:20.239293 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-73f9ff2e-b8d9-4b22-9bde-8ed547fb7993 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.747193 May 17 18:13:20.241666 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 37/77] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:19 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:13:20.254689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-29e07830-714a-413e-abc1-0bc2d8dd192b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:20.262652 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-11d11e69-141e-4630-bd33-810aa57e1060 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:20.264982 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-11d11e69-141e-4630-bd33-810aa57e1060 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:20.266344 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-29e07830-714a-413e-abc1-0bc2d8dd192b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.793751 May 17 18:13:20.276890 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 41/78] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:19 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:20.288586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6925bc16-560f-425a-bb33-ec1383995fd6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:20.292325 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11d11e69-141e-4630-bd33-810aa57e1060 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:20.292884 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11d11e69-141e-4630-bd33-810aa57e1060 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:20.293725 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11d11e69-141e-4630-bd33-810aa57e1060 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:20.294175 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11d11e69-141e-4630-bd33-810aa57e1060 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:20.294521 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6925bc16-560f-425a-bb33-ec1383995fd6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:20.311387 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6925bc16-560f-425a-bb33-ec1383995fd6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:20.311854 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6925bc16-560f-425a-bb33-ec1383995fd6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:20.312692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6925bc16-560f-425a-bb33-ec1383995fd6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:20.313188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6925bc16-560f-425a-bb33-ec1383995fd6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:20.636492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6925bc16-560f-425a-bb33-ec1383995fd6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:20.648995 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6925bc16-560f-425a-bb33-ec1383995fd6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.379027 May 17 18:13:20.661102 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 42/79] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:20 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:20.799424 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-11d11e69-141e-4630-bd33-810aa57e1060 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:20.828404 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-11d11e69-141e-4630-bd33-810aa57e1060 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.585157 May 17 18:13:20.838140 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 38/80] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:20 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:20.850495 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-eb723d83-8743-4af0-b2b9-2ec4e268a869 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:20.855994 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-eb723d83-8743-4af0-b2b9-2ec4e268a869 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:20.876221 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eb723d83-8743-4af0-b2b9-2ec4e268a869 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:20.876694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eb723d83-8743-4af0-b2b9-2ec4e268a869 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:20.879549 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eb723d83-8743-4af0-b2b9-2ec4e268a869 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:20.881260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eb723d83-8743-4af0-b2b9-2ec4e268a869 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:21.012846 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-5c9043fe-9e2f-440e-9cdc-b8802df66bdf req-0c3e99ec-a727-424c-b102-d36455158df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530a3eb3-cd60-4f22-a693-6221a19eea5f", "tag": "64d89cb2-8631-49b0-85a0-7b9cbfbbffb0"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:21.025315 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-5c9043fe-9e2f-440e-9cdc-b8802df66bdf req-0c3e99ec-a727-424c-b102-d36455158df1 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:21.025985 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-5c9043fe-9e2f-440e-9cdc-b8802df66bdf req-0c3e99ec-a727-424c-b102-d36455158df1 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:21.046195 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-5c9043fe-9e2f-440e-9cdc-b8802df66bdf req-0c3e99ec-a727-424c-b102-d36455158df1 service nova] Creating event network-changed:64d89cb2-8631-49b0-85a0-7b9cbfbbffb0 for instance 530a3eb3-cd60-4f22-a693-6221a19eea5f on hv-cinder-84130 May 17 18:13:21.055104 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-5c9043fe-9e2f-440e-9cdc-b8802df66bdf req-0c3e99ec-a727-424c-b102-d36455158df1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.390001 May 17 18:13:21.058473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 43/81] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:21.075197 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-11ed0ea1-5a67-469a-a78d-e62c8c00a25f req-cb104a9e-7a39-4c30-9039-dcaf5a526ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769abf30-807c-41f0-bd94-0809137c0155", "tag": "cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:21.114040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-11ed0ea1-5a67-469a-a78d-e62c8c00a25f req-cb104a9e-7a39-4c30-9039-dcaf5a526ed0 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:21.116748 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-11ed0ea1-5a67-469a-a78d-e62c8c00a25f req-cb104a9e-7a39-4c30-9039-dcaf5a526ed0 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:21.151945 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-11ed0ea1-5a67-469a-a78d-e62c8c00a25f req-cb104a9e-7a39-4c30-9039-dcaf5a526ed0 service nova] Creating event network-changed:cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb for instance 769abf30-807c-41f0-bd94-0809137c0155 on hv-cinder-84130 May 17 18:13:21.163109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-11ed0ea1-5a67-469a-a78d-e62c8c00a25f req-cb104a9e-7a39-4c30-9039-dcaf5a526ed0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100541 May 17 18:13:21.165908 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 44/82] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:21.267106 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a305026a-21ca-4a53-b809-fa0ba275e472 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:21.268341 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a305026a-21ca-4a53-b809-fa0ba275e472 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:21.293253 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a305026a-21ca-4a53-b809-fa0ba275e472 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:21.296197 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a305026a-21ca-4a53-b809-fa0ba275e472 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:21.297569 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a305026a-21ca-4a53-b809-fa0ba275e472 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:21.298754 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a305026a-21ca-4a53-b809-fa0ba275e472 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:21.303680 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-eb723d83-8743-4af0-b2b9-2ec4e268a869 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:21.319293 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-eb723d83-8743-4af0-b2b9-2ec4e268a869 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1315 microversion: 2.1 time: 0.482241 May 17 18:13:21.320177 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 39/83] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:20 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:21.325773 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bc9b6a07-3f9c-429b-b4b2-548f01e86b04 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:21.326461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-bc9b6a07-3f9c-429b-b4b2-548f01e86b04 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:21.342246 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bc9b6a07-3f9c-429b-b4b2-548f01e86b04 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:21.342774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bc9b6a07-3f9c-429b-b4b2-548f01e86b04 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:21.343575 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bc9b6a07-3f9c-429b-b4b2-548f01e86b04 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:21.344023 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bc9b6a07-3f9c-429b-b4b2-548f01e86b04 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:21.621842 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a305026a-21ca-4a53-b809-fa0ba275e472 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:21.639240 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-bc9b6a07-3f9c-429b-b4b2-548f01e86b04 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:21.640089 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a305026a-21ca-4a53-b809-fa0ba275e472 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:21.644714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a305026a-21ca-4a53-b809-fa0ba275e472 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:21.647266 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a305026a-21ca-4a53-b809-fa0ba275e472 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.390827 May 17 18:13:21.647389 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-bc9b6a07-3f9c-429b-b4b2-548f01e86b04 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.326113 May 17 18:13:21.648395 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 45/84] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:21 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:21.659591 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 40/85] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:21 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:21.669635 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-49290c1b-f7f3-48f5-ab41-99d1a56df665 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:21.670488 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-49290c1b-f7f3-48f5-ab41-99d1a56df665 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:21.687472 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-49290c1b-f7f3-48f5-ab41-99d1a56df665 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:21.687943 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-49290c1b-f7f3-48f5-ab41-99d1a56df665 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:21.689404 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-49290c1b-f7f3-48f5-ab41-99d1a56df665 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:21.689576 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-49290c1b-f7f3-48f5-ab41-99d1a56df665 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:21.845201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8d19b9df-c6d1-4ce7-9024-79892b7ae33b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:21.845817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8d19b9df-c6d1-4ce7-9024-79892b7ae33b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:21.862230 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8d19b9df-c6d1-4ce7-9024-79892b7ae33b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:21.864060 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8d19b9df-c6d1-4ce7-9024-79892b7ae33b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:21.867468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8d19b9df-c6d1-4ce7-9024-79892b7ae33b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:21.869184 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8d19b9df-c6d1-4ce7-9024-79892b7ae33b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:22.105013 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-49290c1b-f7f3-48f5-ab41-99d1a56df665 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:22.132311 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-49290c1b-f7f3-48f5-ab41-99d1a56df665 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.466493 May 17 18:13:22.146320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 46/86] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:21 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:22.226026 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8d19b9df-c6d1-4ce7-9024-79892b7ae33b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:22.257673 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8d19b9df-c6d1-4ce7-9024-79892b7ae33b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.416197 May 17 18:13:22.258265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 41/87] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:21 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:22.336582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f7cee566-8da0-4e21-b8fb-8842a01691ca tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:22.337483 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f7cee566-8da0-4e21-b8fb-8842a01691ca tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:22.348842 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7cee566-8da0-4e21-b8fb-8842a01691ca tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:22.349303 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7cee566-8da0-4e21-b8fb-8842a01691ca tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:22.350117 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7cee566-8da0-4e21-b8fb-8842a01691ca tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:22.350554 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7cee566-8da0-4e21-b8fb-8842a01691ca tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:22.642897 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f7cee566-8da0-4e21-b8fb-8842a01691ca tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:22.650699 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f7cee566-8da0-4e21-b8fb-8842a01691ca tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1502 microversion: 2.1 time: 0.317801 May 17 18:13:22.652274 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 47/88] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:22 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1502 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:22.668492 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2c3f59f2-2e42-40c3-ae49-98b7f9322103 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:22.669479 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2c3f59f2-2e42-40c3-ae49-98b7f9322103 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:22.694273 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-350c4a4c-18c6-472d-8f0c-07bea51a082b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:22.694273 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-350c4a4c-18c6-472d-8f0c-07bea51a082b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:22.694446 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2c3f59f2-2e42-40c3-ae49-98b7f9322103 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:22.694822 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2c3f59f2-2e42-40c3-ae49-98b7f9322103 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:22.695820 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2c3f59f2-2e42-40c3-ae49-98b7f9322103 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:22.696765 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2c3f59f2-2e42-40c3-ae49-98b7f9322103 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:22.709577 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-350c4a4c-18c6-472d-8f0c-07bea51a082b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:22.713923 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-350c4a4c-18c6-472d-8f0c-07bea51a082b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:22.715436 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-350c4a4c-18c6-472d-8f0c-07bea51a082b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:22.715981 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-350c4a4c-18c6-472d-8f0c-07bea51a082b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:23.296285 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-350c4a4c-18c6-472d-8f0c-07bea51a082b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:23.304557 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-350c4a4c-18c6-472d-8f0c-07bea51a082b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:23.306113 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-350c4a4c-18c6-472d-8f0c-07bea51a082b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:23.312266 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-350c4a4c-18c6-472d-8f0c-07bea51a082b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.633140 May 17 18:13:23.312916 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 48/89] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:22 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:23.324588 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b330cfbe-41c5-4bb1-9502-0748a8301f00 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:23.324588 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b330cfbe-41c5-4bb1-9502-0748a8301f00 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:23.340378 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b330cfbe-41c5-4bb1-9502-0748a8301f00 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:23.340841 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b330cfbe-41c5-4bb1-9502-0748a8301f00 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:23.342794 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b330cfbe-41c5-4bb1-9502-0748a8301f00 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:23.343247 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b330cfbe-41c5-4bb1-9502-0748a8301f00 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:23.405847 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2c3f59f2-2e42-40c3-ae49-98b7f9322103 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:23.416750 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2c3f59f2-2e42-40c3-ae49-98b7f9322103 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.755225 May 17 18:13:23.417677 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 42/90] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:22 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:23.422478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-f1a5c748-9f83-4456-8211-a63334728c8c req-2f976fb0-a9be-4ecc-a556-1b8e662434d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a4f1963-1182-4b7f-8347-100ee3382934", "tag": "b838f220-05d5-453b-ad0a-34c550efa484"}, {"name": "network-changed", "server_uuid": "866f96bb-2e7f-45e6-be98-859df625039a", "tag": "e8f715c1-6f11-4eda-a7e2-1cb6b1f3cbcf"}, {"name": "network-changed", "server_uuid": "dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7", "tag": "00461b29-1b83-4cbe-b27b-1a409ac59ea0"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:23.449018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-f1a5c748-9f83-4456-8211-a63334728c8c req-2f976fb0-a9be-4ecc-a556-1b8e662434d4 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:23.449650 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-f1a5c748-9f83-4456-8211-a63334728c8c req-2f976fb0-a9be-4ecc-a556-1b8e662434d4 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:23.480059 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-f1a5c748-9f83-4456-8211-a63334728c8c req-2f976fb0-a9be-4ecc-a556-1b8e662434d4 service nova] Creating event network-changed:b838f220-05d5-453b-ad0a-34c550efa484 for instance 1a4f1963-1182-4b7f-8347-100ee3382934 on hv-cinder-84130 May 17 18:13:23.481427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-f1a5c748-9f83-4456-8211-a63334728c8c req-2f976fb0-a9be-4ecc-a556-1b8e662434d4 service nova] Creating event network-changed:e8f715c1-6f11-4eda-a7e2-1cb6b1f3cbcf for instance 866f96bb-2e7f-45e6-be98-859df625039a on hv-cinder-84130 May 17 18:13:23.483341 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-f1a5c748-9f83-4456-8211-a63334728c8c req-2f976fb0-a9be-4ecc-a556-1b8e662434d4 service nova] Creating event network-changed:00461b29-1b83-4cbe-b27b-1a409ac59ea0 for instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 on hv-cinder-84130 May 17 18:13:23.501302 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-f1a5c748-9f83-4456-8211-a63334728c8c req-2f976fb0-a9be-4ecc-a556-1b8e662434d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.080946 May 17 18:13:23.503292 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 43/91] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:23.514431 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ff926ac7-79b0-40c6-9d65-8fd73113a435 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:23.524091 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ff926ac7-79b0-40c6-9d65-8fd73113a435 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:23.536225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ff926ac7-79b0-40c6-9d65-8fd73113a435 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:23.536730 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ff926ac7-79b0-40c6-9d65-8fd73113a435 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:23.537630 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ff926ac7-79b0-40c6-9d65-8fd73113a435 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:23.538187 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ff926ac7-79b0-40c6-9d65-8fd73113a435 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:23.911089 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b330cfbe-41c5-4bb1-9502-0748a8301f00 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:23.926782 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b330cfbe-41c5-4bb1-9502-0748a8301f00 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.612216 May 17 18:13:23.939201 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 49/92] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:23 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:24.052660 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ff926ac7-79b0-40c6-9d65-8fd73113a435 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:24.072167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ff926ac7-79b0-40c6-9d65-8fd73113a435 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.566308 May 17 18:13:24.075425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 44/93] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:23 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:24.323220 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9d1c7c9f-af63-48ef-abeb-b2095564e306 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7090dcd-0f46-4ddc-a7f6-8ae26d743e8a"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:24.324335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9d1c7c9f-af63-48ef-abeb-b2095564e306 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:24.330401 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d1c7c9f-af63-48ef-abeb-b2095564e306 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:24.331176 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d1c7c9f-af63-48ef-abeb-b2095564e306 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:24.332279 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d1c7c9f-af63-48ef-abeb-b2095564e306 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:24.332864 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d1c7c9f-af63-48ef-abeb-b2095564e306 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:24.341167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-101f51e0-1bb9-4d51-918f-cd11850ba6d3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:24.341799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-101f51e0-1bb9-4d51-918f-cd11850ba6d3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:24.352885 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-101f51e0-1bb9-4d51-918f-cd11850ba6d3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:24.353494 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-101f51e0-1bb9-4d51-918f-cd11850ba6d3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:24.354525 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-101f51e0-1bb9-4d51-918f-cd11850ba6d3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:24.355006 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-101f51e0-1bb9-4d51-918f-cd11850ba6d3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:24.599198 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-101f51e0-1bb9-4d51-918f-cd11850ba6d3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:24.616196 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-101f51e0-1bb9-4d51-918f-cd11850ba6d3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:24.617689 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-101f51e0-1bb9-4d51-918f-cd11850ba6d3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:24.620025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-101f51e0-1bb9-4d51-918f-cd11850ba6d3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.287994 May 17 18:13:24.620488 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 45/94] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:24 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:13:24.634678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4d71c07c-61f4-426e-9fc1-f85698b670be tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:24.635307 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4d71c07c-61f4-426e-9fc1-f85698b670be tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:24.641268 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d71c07c-61f4-426e-9fc1-f85698b670be tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:24.642037 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d71c07c-61f4-426e-9fc1-f85698b670be tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:24.642977 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d71c07c-61f4-426e-9fc1-f85698b670be tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:24.643428 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d71c07c-61f4-426e-9fc1-f85698b670be tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:24.810283 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4d71c07c-61f4-426e-9fc1-f85698b670be tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:24.818135 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4d71c07c-61f4-426e-9fc1-f85698b670be tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.196236 May 17 18:13:24.829052 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 46/95] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:24 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:24.945532 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3e55c8ce-4c24-4df5-969d-bebcd741a0df tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:24.947086 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3e55c8ce-4c24-4df5-969d-bebcd741a0df tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:24.953847 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3e55c8ce-4c24-4df5-969d-bebcd741a0df tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:24.954896 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3e55c8ce-4c24-4df5-969d-bebcd741a0df tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:24.956055 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3e55c8ce-4c24-4df5-969d-bebcd741a0df tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:24.956578 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3e55c8ce-4c24-4df5-969d-bebcd741a0df tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:25.116814 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3e55c8ce-4c24-4df5-969d-bebcd741a0df tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:25.133007 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3e55c8ce-4c24-4df5-969d-bebcd741a0df tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.189763 May 17 18:13:25.135138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 47/96] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:24 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:25.144491 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e6303393-eb3c-4d7b-9dcd-ed51c7cc1b0a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:25.145116 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e6303393-eb3c-4d7b-9dcd-ed51c7cc1b0a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:25.163509 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e6303393-eb3c-4d7b-9dcd-ed51c7cc1b0a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:25.166366 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e6303393-eb3c-4d7b-9dcd-ed51c7cc1b0a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:25.167308 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e6303393-eb3c-4d7b-9dcd-ed51c7cc1b0a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:25.171172 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e6303393-eb3c-4d7b-9dcd-ed51c7cc1b0a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:25.455352 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e6303393-eb3c-4d7b-9dcd-ed51c7cc1b0a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:25.465859 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e6303393-eb3c-4d7b-9dcd-ed51c7cc1b0a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.329446 May 17 18:13:25.466801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 48/97] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:25 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:25.639880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7eec1c12-b14a-4350-b525-4282b5f81526 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:25.640664 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7eec1c12-b14a-4350-b525-4282b5f81526 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:25.653789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7eec1c12-b14a-4350-b525-4282b5f81526 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:25.655552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7eec1c12-b14a-4350-b525-4282b5f81526 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:25.656341 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7eec1c12-b14a-4350-b525-4282b5f81526 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:25.663666 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7eec1c12-b14a-4350-b525-4282b5f81526 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:25.857692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7eec1c12-b14a-4350-b525-4282b5f81526 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:25.867594 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7eec1c12-b14a-4350-b525-4282b5f81526 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:25.869438 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7eec1c12-b14a-4350-b525-4282b5f81526 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:25.870731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7eec1c12-b14a-4350-b525-4282b5f81526 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.236689 May 17 18:13:25.871762 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 49/98] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:25 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:13:25.879853 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e5d451fe-571b-44e3-901a-b9a1654f6c4c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:25.880678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e5d451fe-571b-44e3-901a-b9a1654f6c4c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:25.895509 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e5d451fe-571b-44e3-901a-b9a1654f6c4c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:25.896175 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e5d451fe-571b-44e3-901a-b9a1654f6c4c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:25.897378 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e5d451fe-571b-44e3-901a-b9a1654f6c4c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:25.898245 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e5d451fe-571b-44e3-901a-b9a1654f6c4c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:26.066503 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e5d451fe-571b-44e3-901a-b9a1654f6c4c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:26.095157 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e5d451fe-571b-44e3-901a-b9a1654f6c4c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.203450 May 17 18:13:26.096846 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 50/99] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:25 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:26.152859 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-67f923a1-975c-4e06-af80-2501ef2c9885 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:26.153500 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-67f923a1-975c-4e06-af80-2501ef2c9885 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:26.162084 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67f923a1-975c-4e06-af80-2501ef2c9885 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:26.162543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67f923a1-975c-4e06-af80-2501ef2c9885 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:26.163340 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67f923a1-975c-4e06-af80-2501ef2c9885 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:26.163777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67f923a1-975c-4e06-af80-2501ef2c9885 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:26.418555 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-67f923a1-975c-4e06-af80-2501ef2c9885 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:26.425744 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-67f923a1-975c-4e06-af80-2501ef2c9885 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.278186 May 17 18:13:26.435749 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 51/100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:26 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:26.482001 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-010ef1dd-6976-4ea8-a06c-6e8601e5bb20 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:26.482661 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-010ef1dd-6976-4ea8-a06c-6e8601e5bb20 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:26.490950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-010ef1dd-6976-4ea8-a06c-6e8601e5bb20 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:26.492275 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-010ef1dd-6976-4ea8-a06c-6e8601e5bb20 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:26.495612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-010ef1dd-6976-4ea8-a06c-6e8601e5bb20 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:26.496299 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-010ef1dd-6976-4ea8-a06c-6e8601e5bb20 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:26.702952 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-010ef1dd-6976-4ea8-a06c-6e8601e5bb20 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:26.713408 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-010ef1dd-6976-4ea8-a06c-6e8601e5bb20 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.235150 May 17 18:13:26.714248 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 52/101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:26 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:26.903588 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-eb3f7c5d-3b43-4a8d-ade7-43ef70eef237 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:26.905399 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-eb3f7c5d-3b43-4a8d-ade7-43ef70eef237 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:26.928331 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eb3f7c5d-3b43-4a8d-ade7-43ef70eef237 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:26.928862 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eb3f7c5d-3b43-4a8d-ade7-43ef70eef237 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:26.931831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eb3f7c5d-3b43-4a8d-ade7-43ef70eef237 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:26.932312 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eb3f7c5d-3b43-4a8d-ade7-43ef70eef237 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:27.116531 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-eb3f7c5d-3b43-4a8d-ade7-43ef70eef237 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:27.127766 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-eb3f7c5d-3b43-4a8d-ade7-43ef70eef237 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:27.129768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-eb3f7c5d-3b43-4a8d-ade7-43ef70eef237 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:27.131685 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-eb3f7c5d-3b43-4a8d-ade7-43ef70eef237 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.244627 May 17 18:13:27.133005 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 53/102] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:26 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:27.140643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9dd09519-a939-4fe4-b957-cb46bd11a669 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:27.142014 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9dd09519-a939-4fe4-b957-cb46bd11a669 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:27.150153 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9dd09519-a939-4fe4-b957-cb46bd11a669 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:27.150931 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9dd09519-a939-4fe4-b957-cb46bd11a669 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:27.151908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9dd09519-a939-4fe4-b957-cb46bd11a669 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:27.152662 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9dd09519-a939-4fe4-b957-cb46bd11a669 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:27.353168 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9dd09519-a939-4fe4-b957-cb46bd11a669 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:27.360896 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9dd09519-a939-4fe4-b957-cb46bd11a669 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.226096 May 17 18:13:27.361387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 54/103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:27 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:27.443270 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e2c55ab5-46fb-4868-bad7-5e3ef30e33e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:27.443889 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e2c55ab5-46fb-4868-bad7-5e3ef30e33e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:27.467467 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e2c55ab5-46fb-4868-bad7-5e3ef30e33e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:27.468425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e2c55ab5-46fb-4868-bad7-5e3ef30e33e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:27.472557 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e2c55ab5-46fb-4868-bad7-5e3ef30e33e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:27.473297 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e2c55ab5-46fb-4868-bad7-5e3ef30e33e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:27.730824 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9d1c7c9f-af63-48ef-abeb-b2095564e306 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "POST /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.410955 May 17 18:13:27.732084 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 50/104] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:13:24 2022] POST /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61/os-volume_attachments => generated 194 bytes in 3414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:13:27.757794 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-f80dc530-2e32-48b6-b988-cf0c3c15c580 req-e34092bd-ded5-4b8c-ab92-3033cc0b6834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530a3eb3-cd60-4f22-a693-6221a19eea5f", "name": "network-vif-plugged", "status": "completed", "tag": "64d89cb2-8631-49b0-85a0-7b9cbfbbffb0"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:27.781686 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-f80dc530-2e32-48b6-b988-cf0c3c15c580 req-e34092bd-ded5-4b8c-ab92-3033cc0b6834 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:27.782146 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-f80dc530-2e32-48b6-b988-cf0c3c15c580 req-e34092bd-ded5-4b8c-ab92-3033cc0b6834 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:27.799044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-f80dc530-2e32-48b6-b988-cf0c3c15c580 req-e34092bd-ded5-4b8c-ab92-3033cc0b6834 service nova] Creating event network-vif-plugged:64d89cb2-8631-49b0-85a0-7b9cbfbbffb0 for instance 530a3eb3-cd60-4f22-a693-6221a19eea5f on hv-cinder-84130 May 17 18:13:27.805786 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-f80dc530-2e32-48b6-b988-cf0c3c15c580 req-e34092bd-ded5-4b8c-ab92-3033cc0b6834 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071727 May 17 18:13:27.806275 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 51/105] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:27.813535 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ec614c78-7561-49fb-b111-124b302ea523 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:27.814265 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ec614c78-7561-49fb-b111-124b302ea523 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:27.839217 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ec614c78-7561-49fb-b111-124b302ea523 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:27.839786 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ec614c78-7561-49fb-b111-124b302ea523 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:27.840585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ec614c78-7561-49fb-b111-124b302ea523 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:27.841005 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ec614c78-7561-49fb-b111-124b302ea523 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:27.982182 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e2c55ab5-46fb-4868-bad7-5e3ef30e33e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:27.994760 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e2c55ab5-46fb-4868-bad7-5e3ef30e33e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.555793 May 17 18:13:27.997339 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 55/106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:27 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:28.143375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ec614c78-7561-49fb-b111-124b302ea523 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:28.151864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7718ce2f-38cd-487a-8db3-1d553b379ec3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:28.152572 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7718ce2f-38cd-487a-8db3-1d553b379ec3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:28.162109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ec614c78-7561-49fb-b111-124b302ea523 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.351146 May 17 18:13:28.164441 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7718ce2f-38cd-487a-8db3-1d553b379ec3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:28.166053 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7718ce2f-38cd-487a-8db3-1d553b379ec3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:28.166943 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7718ce2f-38cd-487a-8db3-1d553b379ec3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:28.167591 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7718ce2f-38cd-487a-8db3-1d553b379ec3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:28.174401 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 52/107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:27 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:28.379526 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-cf54f414-dcde-417c-9a69-18a26907d516 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:28.380401 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-cf54f414-dcde-417c-9a69-18a26907d516 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:28.385254 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7718ce2f-38cd-487a-8db3-1d553b379ec3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:28.394682 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cf54f414-dcde-417c-9a69-18a26907d516 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:28.395211 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7718ce2f-38cd-487a-8db3-1d553b379ec3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:28.395431 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cf54f414-dcde-417c-9a69-18a26907d516 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:28.396320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cf54f414-dcde-417c-9a69-18a26907d516 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:28.396771 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7718ce2f-38cd-487a-8db3-1d553b379ec3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:28.397909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7718ce2f-38cd-487a-8db3-1d553b379ec3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.251175 May 17 18:13:28.398276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cf54f414-dcde-417c-9a69-18a26907d516 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:28.398464 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 56/108] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:28 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:13:28.597790 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-cf54f414-dcde-417c-9a69-18a26907d516 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:28.606843 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-cf54f414-dcde-417c-9a69-18a26907d516 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.232972 May 17 18:13:28.614102 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 53/109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:28 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:29.017076 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-04cd29e6-3731-40ea-a1be-f99b60f3bb27 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:29.017929 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-04cd29e6-3731-40ea-a1be-f99b60f3bb27 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:29.032452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-04cd29e6-3731-40ea-a1be-f99b60f3bb27 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:29.036004 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-04cd29e6-3731-40ea-a1be-f99b60f3bb27 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:29.038779 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-04cd29e6-3731-40ea-a1be-f99b60f3bb27 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:29.040294 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-04cd29e6-3731-40ea-a1be-f99b60f3bb27 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:29.179535 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-396f3edd-c078-4962-b08f-5f88f906de17 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:29.180434 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-396f3edd-c078-4962-b08f-5f88f906de17 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:29.196342 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-396f3edd-c078-4962-b08f-5f88f906de17 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:29.200011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-396f3edd-c078-4962-b08f-5f88f906de17 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:29.229074 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-396f3edd-c078-4962-b08f-5f88f906de17 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:29.231745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-396f3edd-c078-4962-b08f-5f88f906de17 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:29.251972 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-04cd29e6-3731-40ea-a1be-f99b60f3bb27 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:29.262934 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-04cd29e6-3731-40ea-a1be-f99b60f3bb27 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.250112 May 17 18:13:29.275336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 57/110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:29 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:29.418379 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-49bb3467-a227-4f5e-8066-498843a12408 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:29.419317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-49bb3467-a227-4f5e-8066-498843a12408 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:29.429123 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-49bb3467-a227-4f5e-8066-498843a12408 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:29.432217 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-49bb3467-a227-4f5e-8066-498843a12408 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:29.433208 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-49bb3467-a227-4f5e-8066-498843a12408 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:29.433911 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-49bb3467-a227-4f5e-8066-498843a12408 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:29.435092 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-396f3edd-c078-4962-b08f-5f88f906de17 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:29.447404 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-396f3edd-c078-4962-b08f-5f88f906de17 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.271978 May 17 18:13:29.448266 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 54/111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:29 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:29.614326 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-49bb3467-a227-4f5e-8066-498843a12408 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:29.623263 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-49bb3467-a227-4f5e-8066-498843a12408 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:29.623741 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-92cb6320-f8bd-4e22-b0a4-0d5d62150594 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:29.624597 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-92cb6320-f8bd-4e22-b0a4-0d5d62150594 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:29.624723 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-49bb3467-a227-4f5e-8066-498843a12408 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:29.625796 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-49bb3467-a227-4f5e-8066-498843a12408 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.213292 May 17 18:13:29.626359 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 58/112] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:29 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:29.635976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-92cb6320-f8bd-4e22-b0a4-0d5d62150594 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:29.635976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-92cb6320-f8bd-4e22-b0a4-0d5d62150594 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:29.635976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-92cb6320-f8bd-4e22-b0a4-0d5d62150594 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:29.635976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-92cb6320-f8bd-4e22-b0a4-0d5d62150594 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:29.780777 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-92cb6320-f8bd-4e22-b0a4-0d5d62150594 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:29.788528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-92cb6320-f8bd-4e22-b0a4-0d5d62150594 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.168636 May 17 18:13:29.789935 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 55/113] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:29 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:29.840038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-05815591-7a5a-40f2-b56b-093a0c29d8c1 req-a0677efe-d68c-41d4-96c7-7eb17016f9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7", "name": "network-vif-plugged", "status": "completed", "tag": "00461b29-1b83-4cbe-b27b-1a409ac59ea0"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:29.848055 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-05815591-7a5a-40f2-b56b-093a0c29d8c1 req-a0677efe-d68c-41d4-96c7-7eb17016f9ab service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:29.848595 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-05815591-7a5a-40f2-b56b-093a0c29d8c1 req-a0677efe-d68c-41d4-96c7-7eb17016f9ab service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:29.860257 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-05815591-7a5a-40f2-b56b-093a0c29d8c1 req-a0677efe-d68c-41d4-96c7-7eb17016f9ab service nova] Creating event network-vif-plugged:00461b29-1b83-4cbe-b27b-1a409ac59ea0 for instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 on hv-cinder-84130 May 17 18:13:29.865317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-05815591-7a5a-40f2-b56b-093a0c29d8c1 req-a0677efe-d68c-41d4-96c7-7eb17016f9ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028861 May 17 18:13:29.865998 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 59/114] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:30.286340 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8c0419a5-61fb-48d3-bcb2-9d3814a58043 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:30.287670 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8c0419a5-61fb-48d3-bcb2-9d3814a58043 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:30.294177 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8c0419a5-61fb-48d3-bcb2-9d3814a58043 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:30.294677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8c0419a5-61fb-48d3-bcb2-9d3814a58043 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:30.295537 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8c0419a5-61fb-48d3-bcb2-9d3814a58043 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:30.302346 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8c0419a5-61fb-48d3-bcb2-9d3814a58043 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:30.465599 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-39eec494-a00c-468e-89fe-c71beb54649a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:30.467260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-39eec494-a00c-468e-89fe-c71beb54649a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:30.478183 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8c0419a5-61fb-48d3-bcb2-9d3814a58043 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:30.480833 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39eec494-a00c-468e-89fe-c71beb54649a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:30.481303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39eec494-a00c-468e-89fe-c71beb54649a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:30.482538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39eec494-a00c-468e-89fe-c71beb54649a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:30.484277 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39eec494-a00c-468e-89fe-c71beb54649a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:30.486694 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8c0419a5-61fb-48d3-bcb2-9d3814a58043 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.204922 May 17 18:13:30.487485 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 56/115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:30 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:30.645777 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e13f5016-5eb1-48b2-ad9b-e48b02d7bb1f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:30.646767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e13f5016-5eb1-48b2-ad9b-e48b02d7bb1f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:30.653673 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-39eec494-a00c-468e-89fe-c71beb54649a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:30.656616 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e13f5016-5eb1-48b2-ad9b-e48b02d7bb1f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:30.657545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e13f5016-5eb1-48b2-ad9b-e48b02d7bb1f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:30.658893 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e13f5016-5eb1-48b2-ad9b-e48b02d7bb1f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:30.659721 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e13f5016-5eb1-48b2-ad9b-e48b02d7bb1f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:30.661303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-39eec494-a00c-468e-89fe-c71beb54649a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.201033 May 17 18:13:30.661890 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 60/116] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:30 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:30.806831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d813f71e-cbf7-4eb5-a44f-0b080072e800 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:30.807448 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d813f71e-cbf7-4eb5-a44f-0b080072e800 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:30.807940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e13f5016-5eb1-48b2-ad9b-e48b02d7bb1f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:30.813387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d813f71e-cbf7-4eb5-a44f-0b080072e800 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:30.814050 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d813f71e-cbf7-4eb5-a44f-0b080072e800 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:30.814863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d813f71e-cbf7-4eb5-a44f-0b080072e800 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:30.815455 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d813f71e-cbf7-4eb5-a44f-0b080072e800 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:30.816394 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e13f5016-5eb1-48b2-ad9b-e48b02d7bb1f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:30.818360 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e13f5016-5eb1-48b2-ad9b-e48b02d7bb1f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:30.821083 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e13f5016-5eb1-48b2-ad9b-e48b02d7bb1f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.179828 May 17 18:13:30.821686 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 57/117] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:30 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:30.986538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d813f71e-cbf7-4eb5-a44f-0b080072e800 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:30.996112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d813f71e-cbf7-4eb5-a44f-0b080072e800 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.194441 May 17 18:13:30.996697 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 61/118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:30 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:31.503393 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a9d3df6e-2407-4f59-9c2e-2aec142aa2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:31.505089 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a9d3df6e-2407-4f59-9c2e-2aec142aa2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:31.512903 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a9d3df6e-2407-4f59-9c2e-2aec142aa2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:31.513372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a9d3df6e-2407-4f59-9c2e-2aec142aa2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:31.514140 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a9d3df6e-2407-4f59-9c2e-2aec142aa2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:31.514728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a9d3df6e-2407-4f59-9c2e-2aec142aa2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:31.651378 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a9d3df6e-2407-4f59-9c2e-2aec142aa2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:31.659225 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a9d3df6e-2407-4f59-9c2e-2aec142aa2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.159595 May 17 18:13:31.659797 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 58/119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:31 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:31.678322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-16cc1466-c8dd-4d51-9ac2-c3ab64edf309 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:31.678968 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-16cc1466-c8dd-4d51-9ac2-c3ab64edf309 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:31.686164 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-16cc1466-c8dd-4d51-9ac2-c3ab64edf309 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:31.686769 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-16cc1466-c8dd-4d51-9ac2-c3ab64edf309 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:31.687506 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-16cc1466-c8dd-4d51-9ac2-c3ab64edf309 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:31.687953 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-16cc1466-c8dd-4d51-9ac2-c3ab64edf309 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:31.816759 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-16cc1466-c8dd-4d51-9ac2-c3ab64edf309 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:31.824441 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-16cc1466-c8dd-4d51-9ac2-c3ab64edf309 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.149803 May 17 18:13:31.825018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 62/120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:31 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:31.838144 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-16bc19a5-b8e6-4a48-8365-1cef32f2c89b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:31.838878 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-16bc19a5-b8e6-4a48-8365-1cef32f2c89b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:31.844666 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-16bc19a5-b8e6-4a48-8365-1cef32f2c89b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:31.845193 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-16bc19a5-b8e6-4a48-8365-1cef32f2c89b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:31.846018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-16bc19a5-b8e6-4a48-8365-1cef32f2c89b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:31.846535 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-16bc19a5-b8e6-4a48-8365-1cef32f2c89b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:31.976568 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-16bc19a5-b8e6-4a48-8365-1cef32f2c89b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:31.984909 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-16bc19a5-b8e6-4a48-8365-1cef32f2c89b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:31.986392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-16bc19a5-b8e6-4a48-8365-1cef32f2c89b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:31.987635 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-16bc19a5-b8e6-4a48-8365-1cef32f2c89b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.153806 May 17 18:13:31.988197 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 59/121] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:31 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:32.012875 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-31d32446-eddd-4264-9e0e-d755f02dbe40 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:32.013812 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-31d32446-eddd-4264-9e0e-d755f02dbe40 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:32.020115 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31d32446-eddd-4264-9e0e-d755f02dbe40 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:32.020572 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31d32446-eddd-4264-9e0e-d755f02dbe40 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:32.021338 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31d32446-eddd-4264-9e0e-d755f02dbe40 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:32.021776 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31d32446-eddd-4264-9e0e-d755f02dbe40 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:32.166494 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-31d32446-eddd-4264-9e0e-d755f02dbe40 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:32.174424 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-31d32446-eddd-4264-9e0e-d755f02dbe40 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.165554 May 17 18:13:32.179177 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 63/122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:32 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:32.675741 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-79c64228-6cdb-4887-a726-d70efc8d6bf8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:32.676351 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-79c64228-6cdb-4887-a726-d70efc8d6bf8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:32.682784 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-79c64228-6cdb-4887-a726-d70efc8d6bf8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:32.683240 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-79c64228-6cdb-4887-a726-d70efc8d6bf8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:32.684012 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-79c64228-6cdb-4887-a726-d70efc8d6bf8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:32.684450 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-79c64228-6cdb-4887-a726-d70efc8d6bf8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:32.816534 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-79c64228-6cdb-4887-a726-d70efc8d6bf8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:32.824503 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-79c64228-6cdb-4887-a726-d70efc8d6bf8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.152493 May 17 18:13:32.825074 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 60/123] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:32 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:32.842192 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6f015bf1-8574-4913-af79-f78d251bd36b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:32.842192 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6f015bf1-8574-4913-af79-f78d251bd36b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:32.847902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6f015bf1-8574-4913-af79-f78d251bd36b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:32.848356 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6f015bf1-8574-4913-af79-f78d251bd36b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:32.849122 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6f015bf1-8574-4913-af79-f78d251bd36b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:32.849559 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6f015bf1-8574-4913-af79-f78d251bd36b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:32.978486 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6f015bf1-8574-4913-af79-f78d251bd36b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:32.985800 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6f015bf1-8574-4913-af79-f78d251bd36b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.148069 May 17 18:13:32.986363 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 64/124] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:32 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:33.005066 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b284f544-0a8f-455d-bf13-8d51739741bf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:33.005670 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b284f544-0a8f-455d-bf13-8d51739741bf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:33.011944 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b284f544-0a8f-455d-bf13-8d51739741bf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:33.012323 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b284f544-0a8f-455d-bf13-8d51739741bf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:33.013081 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b284f544-0a8f-455d-bf13-8d51739741bf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:33.013513 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b284f544-0a8f-455d-bf13-8d51739741bf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:33.152911 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b284f544-0a8f-455d-bf13-8d51739741bf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:33.161740 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b284f544-0a8f-455d-bf13-8d51739741bf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:33.163605 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b284f544-0a8f-455d-bf13-8d51739741bf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:33.164907 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b284f544-0a8f-455d-bf13-8d51739741bf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.163351 May 17 18:13:33.165867 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 61/125] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:33 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:13:33.191640 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2ee8c3a2-b27c-4bb3-9ab3-ab6ac5358a2d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:33.192342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2ee8c3a2-b27c-4bb3-9ab3-ab6ac5358a2d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:33.202424 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2ee8c3a2-b27c-4bb3-9ab3-ab6ac5358a2d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:33.202988 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2ee8c3a2-b27c-4bb3-9ab3-ab6ac5358a2d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:33.204170 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2ee8c3a2-b27c-4bb3-9ab3-ab6ac5358a2d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:33.204170 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2ee8c3a2-b27c-4bb3-9ab3-ab6ac5358a2d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:33.339335 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2ee8c3a2-b27c-4bb3-9ab3-ab6ac5358a2d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:33.346682 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2ee8c3a2-b27c-4bb3-9ab3-ab6ac5358a2d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.159118 May 17 18:13:33.347261 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 65/126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:33 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:33.841852 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7f5615b1-52dc-49bc-abb2-0b84bd6b8a55 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:33.842512 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7f5615b1-52dc-49bc-abb2-0b84bd6b8a55 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:33.849099 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f5615b1-52dc-49bc-abb2-0b84bd6b8a55 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:33.849552 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f5615b1-52dc-49bc-abb2-0b84bd6b8a55 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:33.850328 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f5615b1-52dc-49bc-abb2-0b84bd6b8a55 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:33.850803 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f5615b1-52dc-49bc-abb2-0b84bd6b8a55 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:33.978482 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7f5615b1-52dc-49bc-abb2-0b84bd6b8a55 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:33.985822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7f5615b1-52dc-49bc-abb2-0b84bd6b8a55 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.147969 May 17 18:13:33.986400 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 62/127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:33 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:34.002564 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-65446784-5ea2-44a4-9070-75759881faa4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:34.003191 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-65446784-5ea2-44a4-9070-75759881faa4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:34.009764 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-65446784-5ea2-44a4-9070-75759881faa4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:34.010210 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-65446784-5ea2-44a4-9070-75759881faa4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:34.011042 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-65446784-5ea2-44a4-9070-75759881faa4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:34.011464 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-65446784-5ea2-44a4-9070-75759881faa4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:34.140501 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-65446784-5ea2-44a4-9070-75759881faa4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:34.147796 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-65446784-5ea2-44a4-9070-75759881faa4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.149137 May 17 18:13:34.157594 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 66/128] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:33 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:34.183767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8849af85-dc9a-4bb2-b075-528367efa918 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:34.184375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8849af85-dc9a-4bb2-b075-528367efa918 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:34.192242 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8849af85-dc9a-4bb2-b075-528367efa918 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:34.192961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8849af85-dc9a-4bb2-b075-528367efa918 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:34.193728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8849af85-dc9a-4bb2-b075-528367efa918 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:34.194279 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8849af85-dc9a-4bb2-b075-528367efa918 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:34.323397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8849af85-dc9a-4bb2-b075-528367efa918 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:34.331195 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8849af85-dc9a-4bb2-b075-528367efa918 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:34.332590 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8849af85-dc9a-4bb2-b075-528367efa918 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:34.333732 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8849af85-dc9a-4bb2-b075-528367efa918 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.154513 May 17 18:13:34.334297 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 63/129] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:34 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:34.363850 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-94f1f7be-9b67-4783-b9a3-17e03076d510 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:34.364467 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-94f1f7be-9b67-4783-b9a3-17e03076d510 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:34.371735 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-94f1f7be-9b67-4783-b9a3-17e03076d510 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:34.372186 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-94f1f7be-9b67-4783-b9a3-17e03076d510 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:34.372965 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-94f1f7be-9b67-4783-b9a3-17e03076d510 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:34.373406 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-94f1f7be-9b67-4783-b9a3-17e03076d510 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:34.507983 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-94f1f7be-9b67-4783-b9a3-17e03076d510 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:34.515898 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-94f1f7be-9b67-4783-b9a3-17e03076d510 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.155823 May 17 18:13:34.516470 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 67/130] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:34 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:35.002660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-72d69ad0-5db3-4e56-a2ac-367541d31a7a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:35.003442 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-72d69ad0-5db3-4e56-a2ac-367541d31a7a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:35.009980 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-72d69ad0-5db3-4e56-a2ac-367541d31a7a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:35.010515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-72d69ad0-5db3-4e56-a2ac-367541d31a7a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:35.011421 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-72d69ad0-5db3-4e56-a2ac-367541d31a7a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:35.011869 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-72d69ad0-5db3-4e56-a2ac-367541d31a7a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:35.148393 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-72d69ad0-5db3-4e56-a2ac-367541d31a7a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:35.155713 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-72d69ad0-5db3-4e56-a2ac-367541d31a7a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.157024 May 17 18:13:35.156269 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 64/131] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:34 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:35.164996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-76de9e23-2856-4bd7-91f4-587b4c81f949 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:35.165779 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-76de9e23-2856-4bd7-91f4-587b4c81f949 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:35.171565 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76de9e23-2856-4bd7-91f4-587b4c81f949 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:35.172013 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76de9e23-2856-4bd7-91f4-587b4c81f949 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:35.172768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76de9e23-2856-4bd7-91f4-587b4c81f949 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:35.173201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76de9e23-2856-4bd7-91f4-587b4c81f949 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:35.299340 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-76de9e23-2856-4bd7-91f4-587b4c81f949 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:35.307271 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-76de9e23-2856-4bd7-91f4-587b4c81f949 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.146615 May 17 18:13:35.307832 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 68/132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:35 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:35.352840 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-aa8add63-7364-4db0-943f-e4b250a30931 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:35.353442 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-aa8add63-7364-4db0-943f-e4b250a30931 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:35.359256 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa8add63-7364-4db0-943f-e4b250a30931 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:35.359706 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa8add63-7364-4db0-943f-e4b250a30931 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:35.360461 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa8add63-7364-4db0-943f-e4b250a30931 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:35.360898 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa8add63-7364-4db0-943f-e4b250a30931 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:35.490548 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-aa8add63-7364-4db0-943f-e4b250a30931 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:35.498316 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-aa8add63-7364-4db0-943f-e4b250a30931 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:35.499876 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-aa8add63-7364-4db0-943f-e4b250a30931 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:35.500970 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-aa8add63-7364-4db0-943f-e4b250a30931 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.152436 May 17 18:13:35.501530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 65/133] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:35 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:35.532409 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ede03d32-a076-4b66-b2e4-3bc96aaf36e4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:35.533050 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ede03d32-a076-4b66-b2e4-3bc96aaf36e4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:35.538912 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ede03d32-a076-4b66-b2e4-3bc96aaf36e4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:35.540018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ede03d32-a076-4b66-b2e4-3bc96aaf36e4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:35.540940 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ede03d32-a076-4b66-b2e4-3bc96aaf36e4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:35.541384 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ede03d32-a076-4b66-b2e4-3bc96aaf36e4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:35.667702 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ede03d32-a076-4b66-b2e4-3bc96aaf36e4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:35.674832 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ede03d32-a076-4b66-b2e4-3bc96aaf36e4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.146158 May 17 18:13:35.675398 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 69/134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:35 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:36.174317 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1edd7dee-0088-4bfc-be4a-250da6e09f3e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:36.175058 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1edd7dee-0088-4bfc-be4a-250da6e09f3e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:36.182537 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1edd7dee-0088-4bfc-be4a-250da6e09f3e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:36.183085 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1edd7dee-0088-4bfc-be4a-250da6e09f3e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:36.183854 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1edd7dee-0088-4bfc-be4a-250da6e09f3e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:36.184286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1edd7dee-0088-4bfc-be4a-250da6e09f3e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:36.319641 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1edd7dee-0088-4bfc-be4a-250da6e09f3e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:36.324094 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-87acfb94-1399-4cb7-9c5c-c693019dccfc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:36.325777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-87acfb94-1399-4cb7-9c5c-c693019dccfc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:36.327734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1edd7dee-0088-4bfc-be4a-250da6e09f3e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.158946 May 17 18:13:36.328470 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 66/135] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:36 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:36.333020 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-87acfb94-1399-4cb7-9c5c-c693019dccfc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:36.333478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-87acfb94-1399-4cb7-9c5c-c693019dccfc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:36.334267 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-87acfb94-1399-4cb7-9c5c-c693019dccfc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:36.334748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-87acfb94-1399-4cb7-9c5c-c693019dccfc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:36.463475 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-87acfb94-1399-4cb7-9c5c-c693019dccfc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:36.470599 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-87acfb94-1399-4cb7-9c5c-c693019dccfc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1364 microversion: 2.1 time: 0.151064 May 17 18:13:36.471176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 70/136] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:36 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:36.517924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1f0aba09-bd18-4ebc-a754-64fdbe0d0aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:36.518530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1f0aba09-bd18-4ebc-a754-64fdbe0d0aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:36.524495 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1f0aba09-bd18-4ebc-a754-64fdbe0d0aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:36.524944 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1f0aba09-bd18-4ebc-a754-64fdbe0d0aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:36.525699 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1f0aba09-bd18-4ebc-a754-64fdbe0d0aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:36.526132 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1f0aba09-bd18-4ebc-a754-64fdbe0d0aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:36.648474 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1f0aba09-bd18-4ebc-a754-64fdbe0d0aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:36.656272 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1f0aba09-bd18-4ebc-a754-64fdbe0d0aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:36.657775 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1f0aba09-bd18-4ebc-a754-64fdbe0d0aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:36.658970 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1f0aba09-bd18-4ebc-a754-64fdbe0d0aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.144851 May 17 18:13:36.659524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 67/137] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:36 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:36.691471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7e1ecee2-7743-481e-87f4-1e38a21345f2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:36.692074 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7e1ecee2-7743-481e-87f4-1e38a21345f2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:36.698270 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7e1ecee2-7743-481e-87f4-1e38a21345f2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:36.698754 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7e1ecee2-7743-481e-87f4-1e38a21345f2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:36.699516 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7e1ecee2-7743-481e-87f4-1e38a21345f2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:36.699950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7e1ecee2-7743-481e-87f4-1e38a21345f2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:36.827262 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7e1ecee2-7743-481e-87f4-1e38a21345f2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:36.834371 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7e1ecee2-7743-481e-87f4-1e38a21345f2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.146669 May 17 18:13:36.834963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 71/138] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:36 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:37.345024 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3aea4f38-4c50-4586-b2fe-6ef1c2b4df40 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:37.345736 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3aea4f38-4c50-4586-b2fe-6ef1c2b4df40 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:37.352983 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3aea4f38-4c50-4586-b2fe-6ef1c2b4df40 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.353440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3aea4f38-4c50-4586-b2fe-6ef1c2b4df40 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.354340 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3aea4f38-4c50-4586-b2fe-6ef1c2b4df40 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.354818 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3aea4f38-4c50-4586-b2fe-6ef1c2b4df40 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.489360 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f6327627-463e-4a5a-950b-6cba9b36f1d4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:37.490946 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f6327627-463e-4a5a-950b-6cba9b36f1d4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:37.499151 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f6327627-463e-4a5a-950b-6cba9b36f1d4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.499887 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f6327627-463e-4a5a-950b-6cba9b36f1d4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.501216 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f6327627-463e-4a5a-950b-6cba9b36f1d4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.502015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f6327627-463e-4a5a-950b-6cba9b36f1d4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.506889 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3aea4f38-4c50-4586-b2fe-6ef1c2b4df40 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:37.515507 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3aea4f38-4c50-4586-b2fe-6ef1c2b4df40 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.174249 May 17 18:13:37.516113 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 68/139] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:37 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:37.536776 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-f346ebad-015f-42ce-87fb-b6dc20b4bb2d req-f0817922-9c7f-4ad5-b4a5-e173f5f03bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769abf30-807c-41f0-bd94-0809137c0155", "name": "network-vif-plugged", "status": "completed", "tag": "cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:37.546167 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-f346ebad-015f-42ce-87fb-b6dc20b4bb2d req-f0817922-9c7f-4ad5-b4a5-e173f5f03bf6 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.546639 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-f346ebad-015f-42ce-87fb-b6dc20b4bb2d req-f0817922-9c7f-4ad5-b4a5-e173f5f03bf6 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.558488 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-f346ebad-015f-42ce-87fb-b6dc20b4bb2d req-f0817922-9c7f-4ad5-b4a5-e173f5f03bf6 service nova] Creating event network-vif-plugged:cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb for instance 769abf30-807c-41f0-bd94-0809137c0155 on hv-cinder-84130 May 17 18:13:37.564376 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-f346ebad-015f-42ce-87fb-b6dc20b4bb2d req-f0817922-9c7f-4ad5-b4a5-e173f5f03bf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032482 May 17 18:13:37.565210 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 69/140] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:37.655591 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f6327627-463e-4a5a-950b-6cba9b36f1d4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:37.663034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f6327627-463e-4a5a-950b-6cba9b36f1d4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1551 microversion: 2.1 time: 0.179122 May 17 18:13:37.663547 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 72/141] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:37 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1551 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:37.677802 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0906eafa-3b8c-4656-aa0d-7b006169303b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:37.678680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0906eafa-3b8c-4656-aa0d-7b006169303b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:37.681272 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0669e88a-eb56-4d7e-b8af-bdaa8f4de40a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:37.681760 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0669e88a-eb56-4d7e-b8af-bdaa8f4de40a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:37.686183 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0906eafa-3b8c-4656-aa0d-7b006169303b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.686673 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0906eafa-3b8c-4656-aa0d-7b006169303b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.687613 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0906eafa-3b8c-4656-aa0d-7b006169303b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.688226 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0906eafa-3b8c-4656-aa0d-7b006169303b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.688353 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0669e88a-eb56-4d7e-b8af-bdaa8f4de40a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.688824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0669e88a-eb56-4d7e-b8af-bdaa8f4de40a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.689606 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0669e88a-eb56-4d7e-b8af-bdaa8f4de40a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.690045 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0669e88a-eb56-4d7e-b8af-bdaa8f4de40a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.843569 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0669e88a-eb56-4d7e-b8af-bdaa8f4de40a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166601 May 17 18:13:37.844412 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 73/142] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 17 18:13:37 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:13:37.854071 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-17054c7c-7954-4d62-8ad6-63651ce1b1d2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:37.854716 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-17054c7c-7954-4d62-8ad6-63651ce1b1d2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:37.862009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-17054c7c-7954-4d62-8ad6-63651ce1b1d2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.862464 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-17054c7c-7954-4d62-8ad6-63651ce1b1d2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.863279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-17054c7c-7954-4d62-8ad6-63651ce1b1d2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:37.863723 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-17054c7c-7954-4d62-8ad6-63651ce1b1d2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:37.872644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0906eafa-3b8c-4656-aa0d-7b006169303b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:37.881417 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0906eafa-3b8c-4656-aa0d-7b006169303b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:37.882943 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0906eafa-3b8c-4656-aa0d-7b006169303b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:37.884264 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0906eafa-3b8c-4656-aa0d-7b006169303b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.210801 May 17 18:13:37.896519 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 70/143] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:37 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:38.026144 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-17054c7c-7954-4d62-8ad6-63651ce1b1d2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:38.033838 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-17054c7c-7954-4d62-8ad6-63651ce1b1d2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.186780 May 17 18:13:38.043282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 74/144] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:37 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:38.535977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-54ad70ba-e966-4aba-bbee-8c122356546a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:38.537772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-54ad70ba-e966-4aba-bbee-8c122356546a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:38.547611 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-54ad70ba-e966-4aba-bbee-8c122356546a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:38.548192 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-54ad70ba-e966-4aba-bbee-8c122356546a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:38.550280 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-54ad70ba-e966-4aba-bbee-8c122356546a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:38.551429 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-54ad70ba-e966-4aba-bbee-8c122356546a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:38.692819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-54ad70ba-e966-4aba-bbee-8c122356546a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:38.701598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-54ad70ba-e966-4aba-bbee-8c122356546a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.171707 May 17 18:13:38.702321 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 71/145] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:38 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:38.902383 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6adb496d-dfd1-4b85-a4d9-57d6783cb537 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:38.903030 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6adb496d-dfd1-4b85-a4d9-57d6783cb537 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:38.908898 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6adb496d-dfd1-4b85-a4d9-57d6783cb537 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:38.909355 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6adb496d-dfd1-4b85-a4d9-57d6783cb537 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:38.910120 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6adb496d-dfd1-4b85-a4d9-57d6783cb537 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:38.910563 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6adb496d-dfd1-4b85-a4d9-57d6783cb537 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:39.039569 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6adb496d-dfd1-4b85-a4d9-57d6783cb537 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:39.047744 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6adb496d-dfd1-4b85-a4d9-57d6783cb537 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:39.049260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6adb496d-dfd1-4b85-a4d9-57d6783cb537 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:39.050374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6adb496d-dfd1-4b85-a4d9-57d6783cb537 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.152634 May 17 18:13:39.050885 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3b8418bd-532a-4ffa-aa5e-0e605a4a4665 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:39.050999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 75/146] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:38 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:39.051509 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3b8418bd-532a-4ffa-aa5e-0e605a4a4665 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:39.057939 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3b8418bd-532a-4ffa-aa5e-0e605a4a4665 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:39.058394 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3b8418bd-532a-4ffa-aa5e-0e605a4a4665 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:39.059268 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3b8418bd-532a-4ffa-aa5e-0e605a4a4665 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:39.059709 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3b8418bd-532a-4ffa-aa5e-0e605a4a4665 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:39.186101 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3b8418bd-532a-4ffa-aa5e-0e605a4a4665 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:39.193866 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3b8418bd-532a-4ffa-aa5e-0e605a4a4665 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.147008 May 17 18:13:39.202976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 72/147] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:39 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:39.237145 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-d671a79a-3547-4ea8-a5ef-d8dcd4614230 req-523ded29-42db-41a6-9b94-88f8c3521888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7", "tag": "00461b29-1b83-4cbe-b27b-1a409ac59ea0"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:39.245634 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-d671a79a-3547-4ea8-a5ef-d8dcd4614230 req-523ded29-42db-41a6-9b94-88f8c3521888 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:39.246082 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-d671a79a-3547-4ea8-a5ef-d8dcd4614230 req-523ded29-42db-41a6-9b94-88f8c3521888 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:39.256577 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-d671a79a-3547-4ea8-a5ef-d8dcd4614230 req-523ded29-42db-41a6-9b94-88f8c3521888 service nova] Creating event network-changed:00461b29-1b83-4cbe-b27b-1a409ac59ea0 for instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 on hv-cinder-84130 May 17 18:13:39.262312 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-d671a79a-3547-4ea8-a5ef-d8dcd4614230 req-523ded29-42db-41a6-9b94-88f8c3521888 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028868 May 17 18:13:39.262933 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 76/148] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:39.582715 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-dc6b5227-a96a-4cd6-86cc-b52acff998f4 req-95b44120-7dbb-41ed-8eed-b07707693b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866f96bb-2e7f-45e6-be98-859df625039a", "name": "network-vif-plugged", "status": "completed", "tag": "e8f715c1-6f11-4eda-a7e2-1cb6b1f3cbcf"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:39.591546 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-dc6b5227-a96a-4cd6-86cc-b52acff998f4 req-95b44120-7dbb-41ed-8eed-b07707693b67 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:39.591967 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-dc6b5227-a96a-4cd6-86cc-b52acff998f4 req-95b44120-7dbb-41ed-8eed-b07707693b67 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:39.605439 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-dc6b5227-a96a-4cd6-86cc-b52acff998f4 req-95b44120-7dbb-41ed-8eed-b07707693b67 service nova] Creating event network-vif-plugged:e8f715c1-6f11-4eda-a7e2-1cb6b1f3cbcf for instance 866f96bb-2e7f-45e6-be98-859df625039a on hv-cinder-84130 May 17 18:13:39.610712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-dc6b5227-a96a-4cd6-86cc-b52acff998f4 req-95b44120-7dbb-41ed-8eed-b07707693b67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031503 May 17 18:13:39.611645 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 73/149] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:39.718117 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-974a5a3b-617d-45d2-95be-42ec46832d1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:39.718839 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-974a5a3b-617d-45d2-95be-42ec46832d1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:39.725559 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-974a5a3b-617d-45d2-95be-42ec46832d1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:39.727836 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-974a5a3b-617d-45d2-95be-42ec46832d1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:39.728799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-974a5a3b-617d-45d2-95be-42ec46832d1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:39.729390 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-974a5a3b-617d-45d2-95be-42ec46832d1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:39.968590 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-974a5a3b-617d-45d2-95be-42ec46832d1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:39.977415 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-974a5a3b-617d-45d2-95be-42ec46832d1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.262828 May 17 18:13:39.978457 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 77/150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:39 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:40.070005 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0d14101c-08f3-4b6b-8620-fc596d5778fe tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:40.072899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0d14101c-08f3-4b6b-8620-fc596d5778fe tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:40.080659 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d14101c-08f3-4b6b-8620-fc596d5778fe tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:40.081115 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d14101c-08f3-4b6b-8620-fc596d5778fe tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:40.081893 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d14101c-08f3-4b6b-8620-fc596d5778fe tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:40.082520 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d14101c-08f3-4b6b-8620-fc596d5778fe tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:40.211728 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-152acb8e-df02-4b2b-83e4-f1d1913b53de tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:40.212378 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-152acb8e-df02-4b2b-83e4-f1d1913b53de tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:40.218304 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-152acb8e-df02-4b2b-83e4-f1d1913b53de tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:40.218795 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-152acb8e-df02-4b2b-83e4-f1d1913b53de tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:40.219576 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-152acb8e-df02-4b2b-83e4-f1d1913b53de tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:40.220340 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-152acb8e-df02-4b2b-83e4-f1d1913b53de tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:40.233748 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0d14101c-08f3-4b6b-8620-fc596d5778fe tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:40.244598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0d14101c-08f3-4b6b-8620-fc596d5778fe tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:40.246226 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0d14101c-08f3-4b6b-8620-fc596d5778fe tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:40.247395 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0d14101c-08f3-4b6b-8620-fc596d5778fe tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.183118 May 17 18:13:40.251133 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 74/151] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:40 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:40.373552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-152acb8e-df02-4b2b-83e4-f1d1913b53de tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:40.380826 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-152acb8e-df02-4b2b-83e4-f1d1913b53de tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.172935 May 17 18:13:40.381737 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 78/152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:40 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:40.994356 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7f599785-2a37-4324-92e6-1fdda075013c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:40.995010 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7f599785-2a37-4324-92e6-1fdda075013c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:41.001683 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f599785-2a37-4324-92e6-1fdda075013c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:41.002145 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f599785-2a37-4324-92e6-1fdda075013c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:41.002941 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f599785-2a37-4324-92e6-1fdda075013c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:41.003537 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f599785-2a37-4324-92e6-1fdda075013c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:41.137635 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7f599785-2a37-4324-92e6-1fdda075013c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:41.144939 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7f599785-2a37-4324-92e6-1fdda075013c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.155054 May 17 18:13:41.145510 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 75/153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:40 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:41.264998 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7f46e1d0-fd6f-450a-a61d-8eb330c144ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:41.265800 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7f46e1d0-fd6f-450a-a61d-8eb330c144ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:41.271999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7f46e1d0-fd6f-450a-a61d-8eb330c144ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:41.272574 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7f46e1d0-fd6f-450a-a61d-8eb330c144ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:41.273316 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7f46e1d0-fd6f-450a-a61d-8eb330c144ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:41.273776 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7f46e1d0-fd6f-450a-a61d-8eb330c144ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:41.399411 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e2925384-21bf-4afd-9290-9c766e9eecdd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:41.400679 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e2925384-21bf-4afd-9290-9c766e9eecdd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:41.407479 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2925384-21bf-4afd-9290-9c766e9eecdd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:41.407924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2925384-21bf-4afd-9290-9c766e9eecdd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:41.408860 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2925384-21bf-4afd-9290-9c766e9eecdd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:41.409295 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2925384-21bf-4afd-9290-9c766e9eecdd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:41.421837 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7f46e1d0-fd6f-450a-a61d-8eb330c144ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:41.433864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7f46e1d0-fd6f-450a-a61d-8eb330c144ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:41.436425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7f46e1d0-fd6f-450a-a61d-8eb330c144ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:41.437854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7f46e1d0-fd6f-450a-a61d-8eb330c144ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.176783 May 17 18:13:41.447935 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 79/154] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:41 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:41.544967 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e2925384-21bf-4afd-9290-9c766e9eecdd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:41.552286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e2925384-21bf-4afd-9290-9c766e9eecdd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.157430 May 17 18:13:41.552944 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 76/155] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:41 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:41.649971 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-d22df2ab-9fc2-421d-8ac4-5b6036d60dcb req-c4201fc6-c6fb-4e38-a2d8-101a78c250de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4f1963-1182-4b7f-8347-100ee3382934", "name": "network-vif-plugged", "status": "completed", "tag": "b838f220-05d5-453b-ad0a-34c550efa484"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:41.659087 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-d22df2ab-9fc2-421d-8ac4-5b6036d60dcb req-c4201fc6-c6fb-4e38-a2d8-101a78c250de service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:41.659823 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-d22df2ab-9fc2-421d-8ac4-5b6036d60dcb req-c4201fc6-c6fb-4e38-a2d8-101a78c250de service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:41.672148 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-d22df2ab-9fc2-421d-8ac4-5b6036d60dcb req-c4201fc6-c6fb-4e38-a2d8-101a78c250de service nova] Creating event network-vif-plugged:b838f220-05d5-453b-ad0a-34c550efa484 for instance 1a4f1963-1182-4b7f-8347-100ee3382934 on hv-cinder-84130 May 17 18:13:41.677653 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-d22df2ab-9fc2-421d-8ac4-5b6036d60dcb req-c4201fc6-c6fb-4e38-a2d8-101a78c250de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 May 17 18:13:41.678346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 80/156] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:42.161144 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-45bafe62-305a-491f-b720-72387562488e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:42.161832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-45bafe62-305a-491f-b720-72387562488e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:42.170103 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-45bafe62-305a-491f-b720-72387562488e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:42.170597 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-45bafe62-305a-491f-b720-72387562488e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:42.171384 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-45bafe62-305a-491f-b720-72387562488e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:42.171828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-45bafe62-305a-491f-b720-72387562488e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:42.373557 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-45bafe62-305a-491f-b720-72387562488e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:42.388958 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-45bafe62-305a-491f-b720-72387562488e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.231551 May 17 18:13:42.394743 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 77/157] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:42 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:42.458171 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1447b7a0-4ed9-4029-91ec-273ce3635a14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:42.458874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1447b7a0-4ed9-4029-91ec-273ce3635a14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:42.466196 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1447b7a0-4ed9-4029-91ec-273ce3635a14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:42.466671 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1447b7a0-4ed9-4029-91ec-273ce3635a14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:42.467495 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1447b7a0-4ed9-4029-91ec-273ce3635a14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:42.467924 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1447b7a0-4ed9-4029-91ec-273ce3635a14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:42.570001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a202ac81-29b7-4a14-8ba2-b52742710aed tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:42.572056 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a202ac81-29b7-4a14-8ba2-b52742710aed tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:42.580216 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a202ac81-29b7-4a14-8ba2-b52742710aed tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:42.580900 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a202ac81-29b7-4a14-8ba2-b52742710aed tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:42.581776 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a202ac81-29b7-4a14-8ba2-b52742710aed tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:42.582308 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a202ac81-29b7-4a14-8ba2-b52742710aed tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:42.635868 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1447b7a0-4ed9-4029-91ec-273ce3635a14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:42.648078 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1447b7a0-4ed9-4029-91ec-273ce3635a14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:42.649963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1447b7a0-4ed9-4029-91ec-273ce3635a14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:42.651154 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1447b7a0-4ed9-4029-91ec-273ce3635a14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.197429 May 17 18:13:42.651884 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 81/158] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:42 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:42.777862 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a202ac81-29b7-4a14-8ba2-b52742710aed tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:42.786761 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a202ac81-29b7-4a14-8ba2-b52742710aed tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.221177 May 17 18:13:42.793218 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 78/159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:42 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:42.926093 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-161475eb-6f6a-4bf8-a186-950b06e12017 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:42.927070 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-161475eb-6f6a-4bf8-a186-950b06e12017 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:42.934001 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-161475eb-6f6a-4bf8-a186-950b06e12017 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:42.934462 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-161475eb-6f6a-4bf8-a186-950b06e12017 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:42.935279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-161475eb-6f6a-4bf8-a186-950b06e12017 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:42.935719 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-161475eb-6f6a-4bf8-a186-950b06e12017 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:42.963185 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-161475eb-6f6a-4bf8-a186-950b06e12017 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Going to try to terminate instance {{(pid=117020) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:13:43.057599 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-161475eb-6f6a-4bf8-a186-950b06e12017 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "DELETE /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 204 len: 0 microversion: 2.1 time: 0.136572 May 17 18:13:43.058182 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 82/160] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:13:42 2022] DELETE /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:13:43.067322 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9a4576b1-a3ac-4612-9ac4-629ec23016fb tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:43.068225 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9a4576b1-a3ac-4612-9ac4-629ec23016fb tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:43.074894 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9a4576b1-a3ac-4612-9ac4-629ec23016fb tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:43.075350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9a4576b1-a3ac-4612-9ac4-629ec23016fb tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:43.076122 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9a4576b1-a3ac-4612-9ac4-629ec23016fb tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:43.076555 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9a4576b1-a3ac-4612-9ac4-629ec23016fb tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:43.206608 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9a4576b1-a3ac-4612-9ac4-629ec23016fb tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:43.214976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9a4576b1-a3ac-4612-9ac4-629ec23016fb tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.152061 May 17 18:13:43.215537 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 79/161] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:43 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:43.418854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2a306a5a-7240-42eb-bf8b-c7858af825a8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:43.419553 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2a306a5a-7240-42eb-bf8b-c7858af825a8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:43.425393 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a306a5a-7240-42eb-bf8b-c7858af825a8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:43.425848 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a306a5a-7240-42eb-bf8b-c7858af825a8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:43.426659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a306a5a-7240-42eb-bf8b-c7858af825a8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:43.427272 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a306a5a-7240-42eb-bf8b-c7858af825a8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:43.557862 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2a306a5a-7240-42eb-bf8b-c7858af825a8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:43.565066 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2a306a5a-7240-42eb-bf8b-c7858af825a8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.151555 May 17 18:13:43.565646 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 83/162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:43 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:43.670043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-46e4899d-fedb-45c0-ad4a-fadfd28c2b14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:43.670725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-46e4899d-fedb-45c0-ad4a-fadfd28c2b14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:43.676454 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46e4899d-fedb-45c0-ad4a-fadfd28c2b14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:43.676912 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46e4899d-fedb-45c0-ad4a-fadfd28c2b14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:43.677675 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46e4899d-fedb-45c0-ad4a-fadfd28c2b14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:43.678115 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46e4899d-fedb-45c0-ad4a-fadfd28c2b14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:43.804606 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-48842f55-c957-486f-9b53-0cb84fccb5f3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:43.805554 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-48842f55-c957-486f-9b53-0cb84fccb5f3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:43.812310 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-48842f55-c957-486f-9b53-0cb84fccb5f3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:43.812871 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-48842f55-c957-486f-9b53-0cb84fccb5f3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:43.813646 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-48842f55-c957-486f-9b53-0cb84fccb5f3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:43.814114 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-48842f55-c957-486f-9b53-0cb84fccb5f3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:43.817293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-46e4899d-fedb-45c0-ad4a-fadfd28c2b14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:43.825522 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-46e4899d-fedb-45c0-ad4a-fadfd28c2b14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:43.827679 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-46e4899d-fedb-45c0-ad4a-fadfd28c2b14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:43.829640 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-46e4899d-fedb-45c0-ad4a-fadfd28c2b14 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.162686 May 17 18:13:43.829640 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 80/163] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:43 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:43.978980 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-48842f55-c957-486f-9b53-0cb84fccb5f3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:43.989369 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-48842f55-c957-486f-9b53-0cb84fccb5f3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.188133 May 17 18:13:43.990392 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 84/164] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:43 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:44.231949 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-175ffb23-4165-4c9d-9a18-1dfdbdd77226 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:44.232817 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-175ffb23-4165-4c9d-9a18-1dfdbdd77226 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:44.239573 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-175ffb23-4165-4c9d-9a18-1dfdbdd77226 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:44.240118 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-175ffb23-4165-4c9d-9a18-1dfdbdd77226 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:44.240962 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-175ffb23-4165-4c9d-9a18-1dfdbdd77226 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:44.241474 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-175ffb23-4165-4c9d-9a18-1dfdbdd77226 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:44.394710 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-175ffb23-4165-4c9d-9a18-1dfdbdd77226 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:44.404603 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-175ffb23-4165-4c9d-9a18-1dfdbdd77226 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.176383 May 17 18:13:44.405198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 81/165] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:44 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:44.582962 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fad1e97a-d9d8-41be-b019-7aa12a0c1c63 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:44.583576 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fad1e97a-d9d8-41be-b019-7aa12a0c1c63 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:44.589655 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fad1e97a-d9d8-41be-b019-7aa12a0c1c63 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:44.590102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fad1e97a-d9d8-41be-b019-7aa12a0c1c63 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:44.590897 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fad1e97a-d9d8-41be-b019-7aa12a0c1c63 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:44.591336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fad1e97a-d9d8-41be-b019-7aa12a0c1c63 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:44.721568 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-fad1e97a-d9d8-41be-b019-7aa12a0c1c63 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:44.729533 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fad1e97a-d9d8-41be-b019-7aa12a0c1c63 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.150439 May 17 18:13:44.730103 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 85/166] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:44 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:44.848044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-561f5cde-924f-488e-88f5-49b1986cb531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:44.848658 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-561f5cde-924f-488e-88f5-49b1986cb531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:44.855878 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-561f5cde-924f-488e-88f5-49b1986cb531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:44.856426 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-561f5cde-924f-488e-88f5-49b1986cb531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:44.857283 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-561f5cde-924f-488e-88f5-49b1986cb531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:44.857926 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-561f5cde-924f-488e-88f5-49b1986cb531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:44.999150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-561f5cde-924f-488e-88f5-49b1986cb531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:45.006853 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-dfb26ba7-636d-4f63-b5f5-7cef9807b230 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:45.007269 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-561f5cde-924f-488e-88f5-49b1986cb531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:45.007675 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-dfb26ba7-636d-4f63-b5f5-7cef9807b230 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:45.009313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-561f5cde-924f-488e-88f5-49b1986cb531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:45.010420 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-561f5cde-924f-488e-88f5-49b1986cb531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.166254 May 17 18:13:45.011319 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 82/167] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:44 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:45.014258 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dfb26ba7-636d-4f63-b5f5-7cef9807b230 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:45.014723 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dfb26ba7-636d-4f63-b5f5-7cef9807b230 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:45.015497 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dfb26ba7-636d-4f63-b5f5-7cef9807b230 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:45.015935 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dfb26ba7-636d-4f63-b5f5-7cef9807b230 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:45.161087 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-dfb26ba7-636d-4f63-b5f5-7cef9807b230 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:45.168594 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-dfb26ba7-636d-4f63-b5f5-7cef9807b230 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.165420 May 17 18:13:45.169176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 86/168] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:45 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:45.421036 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e9688c33-f782-4f0b-a0cc-8d8b2f7f1a51 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:45.421647 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e9688c33-f782-4f0b-a0cc-8d8b2f7f1a51 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:45.427942 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e9688c33-f782-4f0b-a0cc-8d8b2f7f1a51 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:45.428335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e9688c33-f782-4f0b-a0cc-8d8b2f7f1a51 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:45.429105 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e9688c33-f782-4f0b-a0cc-8d8b2f7f1a51 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:45.429553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e9688c33-f782-4f0b-a0cc-8d8b2f7f1a51 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:45.564927 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e9688c33-f782-4f0b-a0cc-8d8b2f7f1a51 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:45.573728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e9688c33-f782-4f0b-a0cc-8d8b2f7f1a51 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.156461 May 17 18:13:45.574301 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 83/169] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:45 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:45.747751 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-99f74ee3-46c3-426c-b34e-8fbbc7b2d57c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:45.748442 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-99f74ee3-46c3-426c-b34e-8fbbc7b2d57c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:45.754174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-99f74ee3-46c3-426c-b34e-8fbbc7b2d57c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:45.754653 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-99f74ee3-46c3-426c-b34e-8fbbc7b2d57c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:45.755410 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-99f74ee3-46c3-426c-b34e-8fbbc7b2d57c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:45.755844 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-99f74ee3-46c3-426c-b34e-8fbbc7b2d57c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:46.029584 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6d0f7639-d776-4e12-a333-79fb2c6dcb3c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:46.030480 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6d0f7639-d776-4e12-a333-79fb2c6dcb3c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:46.036525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d0f7639-d776-4e12-a333-79fb2c6dcb3c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:46.037223 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d0f7639-d776-4e12-a333-79fb2c6dcb3c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:46.038207 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d0f7639-d776-4e12-a333-79fb2c6dcb3c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:46.038875 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d0f7639-d776-4e12-a333-79fb2c6dcb3c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:46.058851 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-99f74ee3-46c3-426c-b34e-8fbbc7b2d57c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:46.068968 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-99f74ee3-46c3-426c-b34e-8fbbc7b2d57c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.325218 May 17 18:13:46.070334 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 87/170] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:45 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:46.174620 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6d0f7639-d776-4e12-a333-79fb2c6dcb3c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:46.183176 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6d0f7639-d776-4e12-a333-79fb2c6dcb3c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:46.184742 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6d0f7639-d776-4e12-a333-79fb2c6dcb3c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:46.186045 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-707ec1e2-3dca-473a-8219-40f01014bb64 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:46.186187 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6d0f7639-d776-4e12-a333-79fb2c6dcb3c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.160394 May 17 18:13:46.186650 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 84/171] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:46 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:46.196900 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-707ec1e2-3dca-473a-8219-40f01014bb64 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:46.196900 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-707ec1e2-3dca-473a-8219-40f01014bb64 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:46.196900 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-707ec1e2-3dca-473a-8219-40f01014bb64 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:46.196900 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-707ec1e2-3dca-473a-8219-40f01014bb64 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:46.197274 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-707ec1e2-3dca-473a-8219-40f01014bb64 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:46.330481 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-707ec1e2-3dca-473a-8219-40f01014bb64 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:46.338495 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-707ec1e2-3dca-473a-8219-40f01014bb64 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.156312 May 17 18:13:46.339318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 88/172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:46 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:46.592787 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0d561922-5dfe-4017-825a-e8459897e444 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:46.593792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0d561922-5dfe-4017-825a-e8459897e444 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:46.600926 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d561922-5dfe-4017-825a-e8459897e444 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:46.601950 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d561922-5dfe-4017-825a-e8459897e444 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:46.602869 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d561922-5dfe-4017-825a-e8459897e444 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:46.603410 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d561922-5dfe-4017-825a-e8459897e444 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:46.770538 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0d561922-5dfe-4017-825a-e8459897e444 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:46.779598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0d561922-5dfe-4017-825a-e8459897e444 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.191800 May 17 18:13:46.780431 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 85/173] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:46 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:47.087261 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-dca44a0c-c20e-478b-bd0a-6ccdbbe3b479 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:47.087967 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-dca44a0c-c20e-478b-bd0a-6ccdbbe3b479 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:47.093930 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dca44a0c-c20e-478b-bd0a-6ccdbbe3b479 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:47.094385 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dca44a0c-c20e-478b-bd0a-6ccdbbe3b479 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:47.095176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dca44a0c-c20e-478b-bd0a-6ccdbbe3b479 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:47.095613 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dca44a0c-c20e-478b-bd0a-6ccdbbe3b479 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:47.205082 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-96eef539-e34a-4118-b589-a7cbfd565c2f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:47.205857 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-96eef539-e34a-4118-b589-a7cbfd565c2f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:47.213078 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-96eef539-e34a-4118-b589-a7cbfd565c2f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:47.213686 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-96eef539-e34a-4118-b589-a7cbfd565c2f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:47.214464 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-96eef539-e34a-4118-b589-a7cbfd565c2f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:47.214947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-96eef539-e34a-4118-b589-a7cbfd565c2f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:47.243241 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-dca44a0c-c20e-478b-bd0a-6ccdbbe3b479 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:47.251037 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-dca44a0c-c20e-478b-bd0a-6ccdbbe3b479 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1321 microversion: 2.1 time: 0.168116 May 17 18:13:47.266733 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 89/174] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:47 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:47.355727 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-df26f3a9-dde7-42b7-8a0b-8becfef4c012 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:47.356341 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-df26f3a9-dde7-42b7-8a0b-8becfef4c012 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:47.362003 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-96eef539-e34a-4118-b589-a7cbfd565c2f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:47.367167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-df26f3a9-dde7-42b7-8a0b-8becfef4c012 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:47.368072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-df26f3a9-dde7-42b7-8a0b-8becfef4c012 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:47.368863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-df26f3a9-dde7-42b7-8a0b-8becfef4c012 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:47.369303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-df26f3a9-dde7-42b7-8a0b-8becfef4c012 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:47.370329 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-96eef539-e34a-4118-b589-a7cbfd565c2f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:47.371918 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-96eef539-e34a-4118-b589-a7cbfd565c2f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:47.373009 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-96eef539-e34a-4118-b589-a7cbfd565c2f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.172557 May 17 18:13:47.373714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 86/175] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:47 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:47.498913 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-df26f3a9-dde7-42b7-8a0b-8becfef4c012 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:47.506062 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-df26f3a9-dde7-42b7-8a0b-8becfef4c012 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.154476 May 17 18:13:47.506753 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 90/176] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:47 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:47.797303 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e160ab64-b087-4f94-9027-6b282e5c74ab tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:47.797813 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e160ab64-b087-4f94-9027-6b282e5c74ab tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:47.804003 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e160ab64-b087-4f94-9027-6b282e5c74ab tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:47.804451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e160ab64-b087-4f94-9027-6b282e5c74ab tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:47.805771 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e160ab64-b087-4f94-9027-6b282e5c74ab tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:47.806203 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e160ab64-b087-4f94-9027-6b282e5c74ab tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:47.942284 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e160ab64-b087-4f94-9027-6b282e5c74ab tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:47.951159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e160ab64-b087-4f94-9027-6b282e5c74ab tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.157794 May 17 18:13:47.951735 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 87/177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:47 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:48.268251 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-cc41bb91-97f7-45f2-922f-d3d85f73161e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:48.268948 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-cc41bb91-97f7-45f2-922f-d3d85f73161e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:48.274756 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc41bb91-97f7-45f2-922f-d3d85f73161e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:48.275209 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc41bb91-97f7-45f2-922f-d3d85f73161e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:48.275982 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc41bb91-97f7-45f2-922f-d3d85f73161e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:48.276421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc41bb91-97f7-45f2-922f-d3d85f73161e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:48.389860 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1534523345", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "networks": [{"uuid": "471818a4-b0b9-4f07-beba-4aaed5602f34"}]}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:48.424864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-cc41bb91-97f7-45f2-922f-d3d85f73161e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:48.433399 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-cc41bb91-97f7-45f2-922f-d3d85f73161e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1516 microversion: 2.1 time: 0.168982 May 17 18:13:48.433973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 91/178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:48 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:48.438788 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b435f3a4-1f84-4f31-8bfa-0a53e2b1cbda tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:48.439547 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b435f3a4-1f84-4f31-8bfa-0a53e2b1cbda tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:48.446981 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b435f3a4-1f84-4f31-8bfa-0a53e2b1cbda tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:48.447432 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b435f3a4-1f84-4f31-8bfa-0a53e2b1cbda tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:48.448188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.network.neutron [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] validate_networks() for [('471818a4-b0b9-4f07-beba-4aaed5602f34', None, None, None, None, None)] {{(pid=117021) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:13:48.448303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b435f3a4-1f84-4f31-8bfa-0a53e2b1cbda tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:48.448615 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b435f3a4-1f84-4f31-8bfa-0a53e2b1cbda tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:48.644694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b435f3a4-1f84-4f31-8bfa-0a53e2b1cbda tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:48.654345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b435f3a4-1f84-4f31-8bfa-0a53e2b1cbda tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:48.655904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b435f3a4-1f84-4f31-8bfa-0a53e2b1cbda tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:48.657019 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b435f3a4-1f84-4f31-8bfa-0a53e2b1cbda tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.222140 May 17 18:13:48.657579 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 92/179] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:48 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:48.668923 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5e78fa65-5b4e-4d30-9616-b8364d89d6b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:48.669974 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5e78fa65-5b4e-4d30-9616-b8364d89d6b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:48.676252 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5e78fa65-5b4e-4d30-9616-b8364d89d6b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:48.676709 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5e78fa65-5b4e-4d30-9616-b8364d89d6b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:48.677489 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5e78fa65-5b4e-4d30-9616-b8364d89d6b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:48.677929 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5e78fa65-5b4e-4d30-9616-b8364d89d6b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:48.707251 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-5e78fa65-5b4e-4d30-9616-b8364d89d6b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lazy-loading 'flavor' on Instance uuid 866f96bb-2e7f-45e6-be98-859df625039a {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:13:48.879512 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5e78fa65-5b4e-4d30-9616-b8364d89d6b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a/action" status: 200 len: 32 microversion: 2.1 time: 0.220457 May 17 18:13:48.880566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 93/180] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:13:48 2022] POST /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:13:48.886744 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-54fa8e87-a7c1-4800-b426-906432a1da2b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:48.887682 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-54fa8e87-a7c1-4800-b426-906432a1da2b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:48.952153 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Flavor limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:13:48.952684 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Image limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:13:48.953263 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Flavor pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:13:48.953680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Image pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:13:48.954120 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:13:48.968955 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:48.970834 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:48.971782 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:48.972193 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:48.995784 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Getting quotas for project 76d421fe5f96421db7d4eeedd205b462. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:13:49.001195 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Getting quotas for user fc7eae5aa3594459bea417a96aae7d8d and project 76d421fe5f96421db7d4eeedd205b462. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:13:49.015871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Going to run 1 instances... {{(pid=117021) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:13:49.019042 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:13:49.057528 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-54fa8e87-a7c1-4800-b426-906432a1da2b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:49.057728 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-54fa8e87-a7c1-4800-b426-906432a1da2b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:49.058918 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-54fa8e87-a7c1-4800-b426-906432a1da2b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:49.059431 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-54fa8e87-a7c1-4800-b426-906432a1da2b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:49.084790 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ac4c01b8-029b-4715-a491-f2accc6fede2 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700129 May 17 18:13:49.086448 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 88/181] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 18:13:49.097307 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-824cdcd5-a8db-4981-aba8-49cd3bbe24d2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:49.098116 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-824cdcd5-a8db-4981-aba8-49cd3bbe24d2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:49.106061 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-824cdcd5-a8db-4981-aba8-49cd3bbe24d2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:49.107025 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-824cdcd5-a8db-4981-aba8-49cd3bbe24d2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:49.109494 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-824cdcd5-a8db-4981-aba8-49cd3bbe24d2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:49.110243 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-824cdcd5-a8db-4981-aba8-49cd3bbe24d2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:49.281060 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-54fa8e87-a7c1-4800-b426-906432a1da2b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:49.288615 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-54fa8e87-a7c1-4800-b426-906432a1da2b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1365 microversion: 2.1 time: 0.406606 May 17 18:13:49.291049 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 94/182] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:48 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:49.296037 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c3d147b7-e09c-44cd-968b-52b344e1469c tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:49.296646 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c3d147b7-e09c-44cd-968b-52b344e1469c tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:49.303425 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-824cdcd5-a8db-4981-aba8-49cd3bbe24d2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:49.306503 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c3d147b7-e09c-44cd-968b-52b344e1469c tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:49.306967 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c3d147b7-e09c-44cd-968b-52b344e1469c tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:49.308148 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c3d147b7-e09c-44cd-968b-52b344e1469c tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:49.308626 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c3d147b7-e09c-44cd-968b-52b344e1469c tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:49.316396 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-824cdcd5-a8db-4981-aba8-49cd3bbe24d2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.222733 May 17 18:13:49.317182 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 89/183] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:49 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:49.322617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-baa8d56c-b804-4e9f-96c0-92c3127461be tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:49.323226 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-baa8d56c-b804-4e9f-96c0-92c3127461be tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:49.468624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-baa8d56c-b804-4e9f-96c0-92c3127461be tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:49.482162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-baa8d56c-b804-4e9f-96c0-92c3127461be tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1219 microversion: 2.1 time: 0.158283 May 17 18:13:49.482162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 90/184] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:49 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:49.513074 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c3d147b7-e09c-44cd-968b-52b344e1469c tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:49.521591 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c3d147b7-e09c-44cd-968b-52b344e1469c tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.229253 May 17 18:13:49.522086 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 95/185] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:49 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:49.674667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-94d79f81-eed6-43ae-ba7b-dc1df753ceb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:49.675277 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-94d79f81-eed6-43ae-ba7b-dc1df753ceb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:49.681648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-94d79f81-eed6-43ae-ba7b-dc1df753ceb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:49.682095 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-94d79f81-eed6-43ae-ba7b-dc1df753ceb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:49.682883 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-94d79f81-eed6-43ae-ba7b-dc1df753ceb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:49.683319 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-94d79f81-eed6-43ae-ba7b-dc1df753ceb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:49.810278 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-94d79f81-eed6-43ae-ba7b-dc1df753ceb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:49.818264 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-94d79f81-eed6-43ae-ba7b-dc1df753ceb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:49.819814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-94d79f81-eed6-43ae-ba7b-dc1df753ceb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:49.821447 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-94d79f81-eed6-43ae-ba7b-dc1df753ceb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.150661 May 17 18:13:49.822007 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 91/186] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:49 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:50.307040 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a370973a-762b-4e66-8eb4-374d77f0fa25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:50.307656 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a370973a-762b-4e66-8eb4-374d77f0fa25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:50.313667 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a370973a-762b-4e66-8eb4-374d77f0fa25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.314119 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a370973a-762b-4e66-8eb4-374d77f0fa25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.314911 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a370973a-762b-4e66-8eb4-374d77f0fa25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.315349 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a370973a-762b-4e66-8eb4-374d77f0fa25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.333905 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8baf20e8-199a-486c-97bf-b65265663243 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:50.334513 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8baf20e8-199a-486c-97bf-b65265663243 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:50.341049 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8baf20e8-199a-486c-97bf-b65265663243 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.341504 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8baf20e8-199a-486c-97bf-b65265663243 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.342279 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8baf20e8-199a-486c-97bf-b65265663243 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.342757 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8baf20e8-199a-486c-97bf-b65265663243 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.511838 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a370973a-762b-4e66-8eb4-374d77f0fa25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:50.519550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a370973a-762b-4e66-8eb4-374d77f0fa25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1555 microversion: 2.1 time: 0.216486 May 17 18:13:50.520111 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 96/187] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:50 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:50.522990 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8baf20e8-199a-486c-97bf-b65265663243 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:50.524803 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6b916198-9924-4f73-b703-fa9d0bc5fdc9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:50.525417 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6b916198-9924-4f73-b703-fa9d0bc5fdc9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:50.531773 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6b916198-9924-4f73-b703-fa9d0bc5fdc9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.531919 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8baf20e8-199a-486c-97bf-b65265663243 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.201547 May 17 18:13:50.532234 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6b916198-9924-4f73-b703-fa9d0bc5fdc9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.532688 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 92/188] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:50 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:50.538449 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6b916198-9924-4f73-b703-fa9d0bc5fdc9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.538724 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a639b6e0-1467-4620-acb1-4478b463b28b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:50.539130 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6b916198-9924-4f73-b703-fa9d0bc5fdc9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.539586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a639b6e0-1467-4620-acb1-4478b463b28b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:50.545492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a639b6e0-1467-4620-acb1-4478b463b28b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.545944 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a639b6e0-1467-4620-acb1-4478b463b28b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.546769 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a639b6e0-1467-4620-acb1-4478b463b28b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.547209 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a639b6e0-1467-4620-acb1-4478b463b28b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.606440 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6b916198-9924-4f73-b703-fa9d0bc5fdc9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:50.613609 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6b916198-9924-4f73-b703-fa9d0bc5fdc9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1223 microversion: 2.1 time: 0.092558 May 17 18:13:50.614177 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 97/189] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:50 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:50.619131 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d4bf8e07-ee26-46f8-9eb5-8b054df034b7 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:50.619744 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d4bf8e07-ee26-46f8-9eb5-8b054df034b7 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:50.625308 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e07-ee26-46f8-9eb5-8b054df034b7 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.625764 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e07-ee26-46f8-9eb5-8b054df034b7 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.626533 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e07-ee26-46f8-9eb5-8b054df034b7 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.627001 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e07-ee26-46f8-9eb5-8b054df034b7 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.642805 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a639b6e0-1467-4620-acb1-4478b463b28b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107743 May 17 18:13:50.643644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 93/190] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 17 18:13:50 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:50.840117 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1227f980-d24e-40d0-8473-2e20e337fbea tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:50.840720 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1227f980-d24e-40d0-8473-2e20e337fbea tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:50.846536 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1227f980-d24e-40d0-8473-2e20e337fbea tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.847027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1227f980-d24e-40d0-8473-2e20e337fbea tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:50.847791 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1227f980-d24e-40d0-8473-2e20e337fbea tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:50.848227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1227f980-d24e-40d0-8473-2e20e337fbea tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:51.007143 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d4bf8e07-ee26-46f8-9eb5-8b054df034b7 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:51.016484 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d4bf8e07-ee26-46f8-9eb5-8b054df034b7 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.401290 May 17 18:13:51.017098 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 98/191] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:50 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:51.087276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1227f980-d24e-40d0-8473-2e20e337fbea tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:51.095247 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1227f980-d24e-40d0-8473-2e20e337fbea tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:51.096839 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1227f980-d24e-40d0-8473-2e20e337fbea tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:51.098048 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1227f980-d24e-40d0-8473-2e20e337fbea tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.262555 May 17 18:13:51.098716 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 94/192] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:50 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:13:51.548706 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4aecb960-b3ca-4a93-8855-e2281015a0a9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:51.549361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4aecb960-b3ca-4a93-8855-e2281015a0a9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:51.555291 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4aecb960-b3ca-4a93-8855-e2281015a0a9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:51.555738 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4aecb960-b3ca-4a93-8855-e2281015a0a9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:51.556533 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4aecb960-b3ca-4a93-8855-e2281015a0a9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:51.556967 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4aecb960-b3ca-4a93-8855-e2281015a0a9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:51.630702 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-662cbc8d-f498-413b-8366-c038ad9acd93 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:51.631408 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-662cbc8d-f498-413b-8366-c038ad9acd93 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:51.638010 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-662cbc8d-f498-413b-8366-c038ad9acd93 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:51.638563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-662cbc8d-f498-413b-8366-c038ad9acd93 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:51.639451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-662cbc8d-f498-413b-8366-c038ad9acd93 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:51.639960 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-662cbc8d-f498-413b-8366-c038ad9acd93 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:51.736342 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-662cbc8d-f498-413b-8366-c038ad9acd93 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:51.743545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-662cbc8d-f498-413b-8366-c038ad9acd93 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1223 microversion: 2.1 time: 0.116705 May 17 18:13:51.744121 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 95/193] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:51 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:13:51.809813 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4aecb960-b3ca-4a93-8855-e2281015a0a9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:51.817399 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4aecb960-b3ca-4a93-8855-e2281015a0a9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.272696 May 17 18:13:51.818420 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 99/194] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:51 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:51.909286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-4dff02db-1673-47ff-a196-dc89747dc1a2 req-1ef7f5cb-b981-48db-af1c-6adcb05cf2cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87868251-b09f-4394-86e6-728fb6e97a61", "name": "network-vif-unplugged", "status": "completed", "tag": "2cbb7559-cda8-4005-8189-124ea3d219b0"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:51.919480 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-4dff02db-1673-47ff-a196-dc89747dc1a2 req-1ef7f5cb-b981-48db-af1c-6adcb05cf2cd service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:51.920296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-4dff02db-1673-47ff-a196-dc89747dc1a2 req-1ef7f5cb-b981-48db-af1c-6adcb05cf2cd service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:51.935094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-4dff02db-1673-47ff-a196-dc89747dc1a2 req-1ef7f5cb-b981-48db-af1c-6adcb05cf2cd service nova] Creating event network-vif-unplugged:2cbb7559-cda8-4005-8189-124ea3d219b0 for instance 87868251-b09f-4394-86e6-728fb6e97a61 on hv-cinder-84130 May 17 18:13:51.940337 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-4dff02db-1673-47ff-a196-dc89747dc1a2 req-1ef7f5cb-b981-48db-af1c-6adcb05cf2cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034675 May 17 18:13:51.941112 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 96/195] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:52.033930 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b7262d7a-80dd-4613-9413-8e39c8847529 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:52.034548 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b7262d7a-80dd-4613-9413-8e39c8847529 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:52.040633 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7262d7a-80dd-4613-9413-8e39c8847529 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:52.041084 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7262d7a-80dd-4613-9413-8e39c8847529 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:52.041883 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7262d7a-80dd-4613-9413-8e39c8847529 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:52.042510 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7262d7a-80dd-4613-9413-8e39c8847529 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:52.117720 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6e572ccb-8f90-43e2-8d73-0d589f38fd74 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:52.118465 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6e572ccb-8f90-43e2-8d73-0d589f38fd74 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:52.124603 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6e572ccb-8f90-43e2-8d73-0d589f38fd74 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:52.125054 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6e572ccb-8f90-43e2-8d73-0d589f38fd74 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:52.125822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6e572ccb-8f90-43e2-8d73-0d589f38fd74 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:52.126258 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6e572ccb-8f90-43e2-8d73-0d589f38fd74 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:52.294875 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b7262d7a-80dd-4613-9413-8e39c8847529 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:52.305087 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b7262d7a-80dd-4613-9413-8e39c8847529 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.274136 May 17 18:13:52.306372 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 100/196] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:52 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:52.313149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-df461235-5ce2-424a-991f-199004b2fa48 req-3e25761f-d207-4ae5-af5b-4de0c00f027a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a4f1963-1182-4b7f-8347-100ee3382934", "tag": "b838f220-05d5-453b-ad0a-34c550efa484"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:52.323390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6e572ccb-8f90-43e2-8d73-0d589f38fd74 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:52.323988 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-df461235-5ce2-424a-991f-199004b2fa48 req-3e25761f-d207-4ae5-af5b-4de0c00f027a service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:52.324576 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-df461235-5ce2-424a-991f-199004b2fa48 req-3e25761f-d207-4ae5-af5b-4de0c00f027a service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:52.332033 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6e572ccb-8f90-43e2-8d73-0d589f38fd74 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:52.333663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6e572ccb-8f90-43e2-8d73-0d589f38fd74 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:52.335037 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6e572ccb-8f90-43e2-8d73-0d589f38fd74 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1404 microversion: 2.20 time: 0.222263 May 17 18:13:52.336157 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 97/197] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:52 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:13:52.344903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-df461235-5ce2-424a-991f-199004b2fa48 req-3e25761f-d207-4ae5-af5b-4de0c00f027a service nova] Creating event network-changed:b838f220-05d5-453b-ad0a-34c550efa484 for instance 1a4f1963-1182-4b7f-8347-100ee3382934 on hv-cinder-84130 May 17 18:13:52.350040 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-df461235-5ce2-424a-991f-199004b2fa48 req-3e25761f-d207-4ae5-af5b-4de0c00f027a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040614 May 17 18:13:52.350652 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 101/198] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:52.760213 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ad501638-8a95-4be1-8239-b80f534ee24f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:52.760946 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ad501638-8a95-4be1-8239-b80f534ee24f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:52.766858 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad501638-8a95-4be1-8239-b80f534ee24f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:52.767335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad501638-8a95-4be1-8239-b80f534ee24f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:52.768107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad501638-8a95-4be1-8239-b80f534ee24f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:52.768547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad501638-8a95-4be1-8239-b80f534ee24f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:52.827646 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ad501638-8a95-4be1-8239-b80f534ee24f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:52.835673 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ad501638-8a95-4be1-8239-b80f534ee24f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1223 microversion: 2.1 time: 0.079868 May 17 18:13:52.839624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 98/199] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:52 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:52.839775 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4fe6cba0-6855-4811-bb0f-69656ee03630 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:52.839775 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4fe6cba0-6855-4811-bb0f-69656ee03630 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:52.844893 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4fe6cba0-6855-4811-bb0f-69656ee03630 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:52.845483 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4fe6cba0-6855-4811-bb0f-69656ee03630 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:52.846376 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4fe6cba0-6855-4811-bb0f-69656ee03630 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:52.846943 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4fe6cba0-6855-4811-bb0f-69656ee03630 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:52.987325 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4fe6cba0-6855-4811-bb0f-69656ee03630 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:52.998213 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4fe6cba0-6855-4811-bb0f-69656ee03630 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.164694 May 17 18:13:52.999169 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 102/200] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:52 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:53.322617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ee992458-0f0d-4a18-af7d-899546f50960 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:53.323252 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ee992458-0f0d-4a18-af7d-899546f50960 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:53.330112 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee992458-0f0d-4a18-af7d-899546f50960 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:53.330613 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee992458-0f0d-4a18-af7d-899546f50960 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:53.331425 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee992458-0f0d-4a18-af7d-899546f50960 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:53.331963 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee992458-0f0d-4a18-af7d-899546f50960 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:53.360858 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ff102f9e-c43c-4e94-b0b8-14e58397408b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:53.361639 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ff102f9e-c43c-4e94-b0b8-14e58397408b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:53.369785 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ff102f9e-c43c-4e94-b0b8-14e58397408b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:53.370367 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ff102f9e-c43c-4e94-b0b8-14e58397408b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:53.371271 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ff102f9e-c43c-4e94-b0b8-14e58397408b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:53.371801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ff102f9e-c43c-4e94-b0b8-14e58397408b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:53.520442 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ee992458-0f0d-4a18-af7d-899546f50960 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:53.528945 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ee992458-0f0d-4a18-af7d-899546f50960 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.210249 May 17 18:13:53.529518 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 99/201] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:53 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:53.550979 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ff102f9e-c43c-4e94-b0b8-14e58397408b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:53.558713 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ff102f9e-c43c-4e94-b0b8-14e58397408b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:53.560228 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ff102f9e-c43c-4e94-b0b8-14e58397408b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:53.561379 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ff102f9e-c43c-4e94-b0b8-14e58397408b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1596 microversion: 2.20 time: 0.210670 May 17 18:13:53.561939 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 103/202] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:13:53 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1596 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:13:53.579715 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1f1a1431-5168-4112-8afa-7a29029daaa8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:53.580251 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1f1a1431-5168-4112-8afa-7a29029daaa8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:53.586788 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1f1a1431-5168-4112-8afa-7a29029daaa8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:53.587219 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1f1a1431-5168-4112-8afa-7a29029daaa8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:53.587977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1f1a1431-5168-4112-8afa-7a29029daaa8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:53.588435 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1f1a1431-5168-4112-8afa-7a29029daaa8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:53.660969 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1f1a1431-5168-4112-8afa-7a29029daaa8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.085385 May 17 18:13:53.661578 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 100/203] 10.222.0.25 () {60 vars in 1315 bytes} [Tue May 17 18:13:53 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:13:53.852734 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e34ddea0-fcbc-4e92-85e4-6a9e53fa3e9c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:53.853351 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e34ddea0-fcbc-4e92-85e4-6a9e53fa3e9c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:53.859414 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e34ddea0-fcbc-4e92-85e4-6a9e53fa3e9c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:53.860140 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e34ddea0-fcbc-4e92-85e4-6a9e53fa3e9c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:53.861017 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e34ddea0-fcbc-4e92-85e4-6a9e53fa3e9c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:53.861555 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e34ddea0-fcbc-4e92-85e4-6a9e53fa3e9c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:53.952126 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e34ddea0-fcbc-4e92-85e4-6a9e53fa3e9c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:53.959474 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e34ddea0-fcbc-4e92-85e4-6a9e53fa3e9c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1223 microversion: 2.1 time: 0.110896 May 17 18:13:53.960045 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 104/204] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:53 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:54.017320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a10fe009-3fc4-4dd8-bfa2-203149a93f50 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:54.017923 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a10fe009-3fc4-4dd8-bfa2-203149a93f50 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:54.023975 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a10fe009-3fc4-4dd8-bfa2-203149a93f50 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:54.024427 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a10fe009-3fc4-4dd8-bfa2-203149a93f50 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:54.025198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a10fe009-3fc4-4dd8-bfa2-203149a93f50 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:54.025646 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a10fe009-3fc4-4dd8-bfa2-203149a93f50 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:54.279872 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a10fe009-3fc4-4dd8-bfa2-203149a93f50 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:54.288446 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a10fe009-3fc4-4dd8-bfa2-203149a93f50 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.274913 May 17 18:13:54.290027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 101/205] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:54 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:54.546615 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a4a5279a-20e0-400e-a3c4-466956f71147 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:54.547172 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a4a5279a-20e0-400e-a3c4-466956f71147 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:54.553114 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a4a5279a-20e0-400e-a3c4-466956f71147 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:54.553572 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a4a5279a-20e0-400e-a3c4-466956f71147 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:54.554378 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a4a5279a-20e0-400e-a3c4-466956f71147 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:54.554844 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a4a5279a-20e0-400e-a3c4-466956f71147 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:54.783805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a4a5279a-20e0-400e-a3c4-466956f71147 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:54.791625 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a4a5279a-20e0-400e-a3c4-466956f71147 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.249224 May 17 18:13:54.792200 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 105/206] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:54 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:54.977173 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1e91d9d7-9d57-4c7d-8b80-8f8835841e71 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:54.977792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1e91d9d7-9d57-4c7d-8b80-8f8835841e71 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:54.996629 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1e91d9d7-9d57-4c7d-8b80-8f8835841e71 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:54.997324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1e91d9d7-9d57-4c7d-8b80-8f8835841e71 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:54.998262 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1e91d9d7-9d57-4c7d-8b80-8f8835841e71 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:54.998992 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1e91d9d7-9d57-4c7d-8b80-8f8835841e71 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:55.141100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-ed68db40-bb6d-4aa1-bbb4-ea8630e196dc req-bcc2adbb-06c8-4081-b2fd-252ec9b0c8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769abf30-807c-41f0-bd94-0809137c0155", "tag": "cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:55.161164 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-ed68db40-bb6d-4aa1-bbb4-ea8630e196dc req-bcc2adbb-06c8-4081-b2fd-252ec9b0c8a6 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:55.161616 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-ed68db40-bb6d-4aa1-bbb4-ea8630e196dc req-bcc2adbb-06c8-4081-b2fd-252ec9b0c8a6 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:55.184256 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-ed68db40-bb6d-4aa1-bbb4-ea8630e196dc req-bcc2adbb-06c8-4081-b2fd-252ec9b0c8a6 service nova] Creating event network-changed:cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb for instance 769abf30-807c-41f0-bd94-0809137c0155 on hv-cinder-84130 May 17 18:13:55.192167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-ed68db40-bb6d-4aa1-bbb4-ea8630e196dc req-bcc2adbb-06c8-4081-b2fd-252ec9b0c8a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054569 May 17 18:13:55.195812 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 106/207] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:55.259320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1e91d9d7-9d57-4c7d-8b80-8f8835841e71 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:55.267412 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1e91d9d7-9d57-4c7d-8b80-8f8835841e71 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1271 microversion: 2.1 time: 0.295084 May 17 18:13:55.278387 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 102/208] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:54 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1271 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:55.306235 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8863e46d-e832-4c53-97fb-d6de334ba2fe tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:55.306965 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8863e46d-e832-4c53-97fb-d6de334ba2fe tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:55.314538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8863e46d-e832-4c53-97fb-d6de334ba2fe tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:55.316417 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8863e46d-e832-4c53-97fb-d6de334ba2fe tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:55.317215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8863e46d-e832-4c53-97fb-d6de334ba2fe tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:55.317947 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8863e46d-e832-4c53-97fb-d6de334ba2fe tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:55.602524 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8863e46d-e832-4c53-97fb-d6de334ba2fe tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:55.610552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8863e46d-e832-4c53-97fb-d6de334ba2fe tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.308847 May 17 18:13:55.614063 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 107/209] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:55 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:55.809304 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e2285f02-5956-4868-b6d7-e95de9439a31 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:55.810539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e2285f02-5956-4868-b6d7-e95de9439a31 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:55.817929 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2285f02-5956-4868-b6d7-e95de9439a31 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:55.818664 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2285f02-5956-4868-b6d7-e95de9439a31 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:55.821088 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2285f02-5956-4868-b6d7-e95de9439a31 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:55.821761 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2285f02-5956-4868-b6d7-e95de9439a31 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:56.000880 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e2285f02-5956-4868-b6d7-e95de9439a31 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:56.010879 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e2285f02-5956-4868-b6d7-e95de9439a31 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1554 microversion: 2.1 time: 0.204934 May 17 18:13:56.021377 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 103/210] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:55 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:56.241266 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-d2a4115d-d7cc-45e2-827f-8e12801d4f01 req-deaf9fd0-8001-4720-82f5-f18707c28b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87868251-b09f-4394-86e6-728fb6e97a61", "name": "network-vif-deleted", "tag": "2cbb7559-cda8-4005-8189-124ea3d219b0"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:13:56.249259 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-d2a4115d-d7cc-45e2-827f-8e12801d4f01 req-deaf9fd0-8001-4720-82f5-f18707c28b1f service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:56.249703 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-d2a4115d-d7cc-45e2-827f-8e12801d4f01 req-deaf9fd0-8001-4720-82f5-f18707c28b1f service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:56.261174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-d2a4115d-d7cc-45e2-827f-8e12801d4f01 req-deaf9fd0-8001-4720-82f5-f18707c28b1f service nova] Creating event network-vif-deleted:2cbb7559-cda8-4005-8189-124ea3d219b0 for instance 87868251-b09f-4394-86e6-728fb6e97a61 on hv-cinder-84130 May 17 18:13:56.266044 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-d2a4115d-d7cc-45e2-827f-8e12801d4f01 req-deaf9fd0-8001-4720-82f5-f18707c28b1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028417 May 17 18:13:56.266667 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 108/211] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:13:56.284569 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4bdb5d78-d049-4d41-92fc-08897349b130 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:56.285289 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4bdb5d78-d049-4d41-92fc-08897349b130 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:56.291709 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4bdb5d78-d049-4d41-92fc-08897349b130 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:56.292246 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4bdb5d78-d049-4d41-92fc-08897349b130 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:56.293019 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4bdb5d78-d049-4d41-92fc-08897349b130 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:56.293460 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4bdb5d78-d049-4d41-92fc-08897349b130 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:56.359205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4bdb5d78-d049-4d41-92fc-08897349b130 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:56.367361 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4bdb5d78-d049-4d41-92fc-08897349b130 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1289 microversion: 2.1 time: 0.086325 May 17 18:13:56.368274 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 104/212] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:56 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:56.634123 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0be71851-3daa-438e-898e-39a5fa72de0f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:56.634879 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0be71851-3daa-438e-898e-39a5fa72de0f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:56.641365 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0be71851-3daa-438e-898e-39a5fa72de0f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:56.641822 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0be71851-3daa-438e-898e-39a5fa72de0f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:56.642630 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0be71851-3daa-438e-898e-39a5fa72de0f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:56.643079 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0be71851-3daa-438e-898e-39a5fa72de0f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:56.769152 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0be71851-3daa-438e-898e-39a5fa72de0f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:56.776617 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0be71851-3daa-438e-898e-39a5fa72de0f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.147270 May 17 18:13:56.777189 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 109/213] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:56 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:57.028326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3e59f69f-12eb-4fa5-9ee5-1c58e1658518 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:57.028943 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3e59f69f-12eb-4fa5-9ee5-1c58e1658518 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:57.035295 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3e59f69f-12eb-4fa5-9ee5-1c58e1658518 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:57.035761 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3e59f69f-12eb-4fa5-9ee5-1c58e1658518 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:57.036607 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3e59f69f-12eb-4fa5-9ee5-1c58e1658518 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:57.037129 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3e59f69f-12eb-4fa5-9ee5-1c58e1658518 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:57.097631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3e59f69f-12eb-4fa5-9ee5-1c58e1658518 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:57.106181 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3e59f69f-12eb-4fa5-9ee5-1c58e1658518 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1512 microversion: 2.1 time: 0.081646 May 17 18:13:57.106771 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 105/214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:57 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1512 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:57.384932 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d7fba3b9-b6d4-48bd-925b-bbbac0410a67 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:57.385459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d7fba3b9-b6d4-48bd-925b-bbbac0410a67 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:57.391444 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d7fba3b9-b6d4-48bd-925b-bbbac0410a67 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:57.391900 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d7fba3b9-b6d4-48bd-925b-bbbac0410a67 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:57.392659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d7fba3b9-b6d4-48bd-925b-bbbac0410a67 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:57.393098 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d7fba3b9-b6d4-48bd-925b-bbbac0410a67 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:57.452216 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d7fba3b9-b6d4-48bd-925b-bbbac0410a67 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:57.459249 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d7fba3b9-b6d4-48bd-925b-bbbac0410a67 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1289 microversion: 2.1 time: 0.078874 May 17 18:13:57.459805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 110/215] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:57 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1289 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:57.793785 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3ec59e57-68d6-4fdf-b791-429d2aa0bf54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:57.794392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3ec59e57-68d6-4fdf-b791-429d2aa0bf54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:57.800536 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ec59e57-68d6-4fdf-b791-429d2aa0bf54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:57.801015 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ec59e57-68d6-4fdf-b791-429d2aa0bf54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:57.801780 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ec59e57-68d6-4fdf-b791-429d2aa0bf54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:57.802213 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ec59e57-68d6-4fdf-b791-429d2aa0bf54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:57.928033 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3ec59e57-68d6-4fdf-b791-429d2aa0bf54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:57.936038 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3ec59e57-68d6-4fdf-b791-429d2aa0bf54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.146085 May 17 18:13:57.936591 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 106/216] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:57 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:58.122890 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-47de466d-78ac-4942-a16d-baa01bb2d92d tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:58.123493 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-47de466d-78ac-4942-a16d-baa01bb2d92d tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:58.129300 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-47de466d-78ac-4942-a16d-baa01bb2d92d tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:58.129746 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-47de466d-78ac-4942-a16d-baa01bb2d92d tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:58.130500 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-47de466d-78ac-4942-a16d-baa01bb2d92d tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:58.131026 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-47de466d-78ac-4942-a16d-baa01bb2d92d tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:58.189918 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-47de466d-78ac-4942-a16d-baa01bb2d92d tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:58.197897 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-47de466d-78ac-4942-a16d-baa01bb2d92d tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1512 microversion: 2.1 time: 0.078902 May 17 18:13:58.198460 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 111/217] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:58 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1512 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:58.475657 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-484f2555-4b85-4b4d-b8f5-22a7199885e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:58.476361 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-484f2555-4b85-4b4d-b8f5-22a7199885e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:58.482648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-484f2555-4b85-4b4d-b8f5-22a7199885e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:58.483107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-484f2555-4b85-4b4d-b8f5-22a7199885e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:58.483870 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-484f2555-4b85-4b4d-b8f5-22a7199885e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:58.484306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-484f2555-4b85-4b4d-b8f5-22a7199885e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:58.554397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-484f2555-4b85-4b4d-b8f5-22a7199885e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:58.561551 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-484f2555-4b85-4b4d-b8f5-22a7199885e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1289 microversion: 2.1 time: 0.089594 May 17 18:13:58.562428 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 107/218] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:58 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:58.953019 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-dae3defa-9f1a-4e1e-a864-bf0e5478ed9e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:58.953757 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-dae3defa-9f1a-4e1e-a864-bf0e5478ed9e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:58.959652 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dae3defa-9f1a-4e1e-a864-bf0e5478ed9e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:58.960104 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dae3defa-9f1a-4e1e-a864-bf0e5478ed9e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:58.960942 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dae3defa-9f1a-4e1e-a864-bf0e5478ed9e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:58.961385 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dae3defa-9f1a-4e1e-a864-bf0e5478ed9e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:59.094253 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-dae3defa-9f1a-4e1e-a864-bf0e5478ed9e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:59.102738 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-dae3defa-9f1a-4e1e-a864-bf0e5478ed9e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.153491 May 17 18:13:59.103681 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 112/219] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:58 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:59.215566 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0b1a3fa6-6e31-45c1-8dcc-a5278cd98db9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:59.216183 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0b1a3fa6-6e31-45c1-8dcc-a5278cd98db9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:59.222045 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0b1a3fa6-6e31-45c1-8dcc-a5278cd98db9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:59.222496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0b1a3fa6-6e31-45c1-8dcc-a5278cd98db9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:59.223298 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0b1a3fa6-6e31-45c1-8dcc-a5278cd98db9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:59.223772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0b1a3fa6-6e31-45c1-8dcc-a5278cd98db9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:59.287802 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0b1a3fa6-6e31-45c1-8dcc-a5278cd98db9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:59.295666 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0b1a3fa6-6e31-45c1-8dcc-a5278cd98db9 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1346 microversion: 2.1 time: 0.084461 May 17 18:13:59.296236 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 108/220] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:59 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:13:59.579334 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-cb5eb8d8-d10a-4d6f-b2fc-615aae2d1090 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:13:59.579990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-cb5eb8d8-d10a-4d6f-b2fc-615aae2d1090 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:13:59.585969 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cb5eb8d8-d10a-4d6f-b2fc-615aae2d1090 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:59.586460 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cb5eb8d8-d10a-4d6f-b2fc-615aae2d1090 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:59.587257 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cb5eb8d8-d10a-4d6f-b2fc-615aae2d1090 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:13:59.587696 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cb5eb8d8-d10a-4d6f-b2fc-615aae2d1090 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:13:59.716888 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-cb5eb8d8-d10a-4d6f-b2fc-615aae2d1090 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:13:59.725351 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-cb5eb8d8-d10a-4d6f-b2fc-615aae2d1090 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1319 microversion: 2.1 time: 0.149811 May 17 18:13:59.725973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 113/221] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:13:59 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:00.119817 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-62d4567b-0756-4576-8ae3-d650d48d9b80 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:00.120347 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-62d4567b-0756-4576-8ae3-d650d48d9b80 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:00.126585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-62d4567b-0756-4576-8ae3-d650d48d9b80 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:00.127044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-62d4567b-0756-4576-8ae3-d650d48d9b80 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:00.127811 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-62d4567b-0756-4576-8ae3-d650d48d9b80 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:00.128244 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-62d4567b-0756-4576-8ae3-d650d48d9b80 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:00.257920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-62d4567b-0756-4576-8ae3-d650d48d9b80 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:00.265110 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-62d4567b-0756-4576-8ae3-d650d48d9b80 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.149348 May 17 18:14:00.265670 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 109/222] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:00 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:00.312456 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-35dbbdf4-3350-408a-9151-8e4bf20e1d2b tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:00.313061 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-35dbbdf4-3350-408a-9151-8e4bf20e1d2b tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:00.319216 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35dbbdf4-3350-408a-9151-8e4bf20e1d2b tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:00.319670 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35dbbdf4-3350-408a-9151-8e4bf20e1d2b tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:00.321068 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35dbbdf4-3350-408a-9151-8e4bf20e1d2b tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:00.321504 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35dbbdf4-3350-408a-9151-8e4bf20e1d2b tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:00.379402 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-35dbbdf4-3350-408a-9151-8e4bf20e1d2b tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:00.387682 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-35dbbdf4-3350-408a-9151-8e4bf20e1d2b tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1346 microversion: 2.1 time: 0.079175 May 17 18:14:00.388252 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 114/223] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:00 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:00.743102 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a6409ed2-b1c3-4cb2-b738-c7555d668bb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:00.743839 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a6409ed2-b1c3-4cb2-b738-c7555d668bb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:00.750213 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a6409ed2-b1c3-4cb2-b738-c7555d668bb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:00.750400 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a6409ed2-b1c3-4cb2-b738-c7555d668bb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:00.751205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a6409ed2-b1c3-4cb2-b738-c7555d668bb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:00.751645 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a6409ed2-b1c3-4cb2-b738-c7555d668bb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:00.876937 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a6409ed2-b1c3-4cb2-b738-c7555d668bb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:00.884693 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a6409ed2-b1c3-4cb2-b738-c7555d668bb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1319 microversion: 2.1 time: 0.146146 May 17 18:14:00.885257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 110/224] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:00 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:01.281878 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0cdaffbb-601c-419c-a403-5e4d9b5bb68c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:01.282487 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0cdaffbb-601c-419c-a403-5e4d9b5bb68c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:01.288713 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0cdaffbb-601c-419c-a403-5e4d9b5bb68c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:01.289174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0cdaffbb-601c-419c-a403-5e4d9b5bb68c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:01.290006 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0cdaffbb-601c-419c-a403-5e4d9b5bb68c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:01.290439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0cdaffbb-601c-419c-a403-5e4d9b5bb68c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:01.404565 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d8193456-273a-4d75-a8be-d56164e67330 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:01.405180 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d8193456-273a-4d75-a8be-d56164e67330 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:01.411599 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d8193456-273a-4d75-a8be-d56164e67330 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:01.412049 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d8193456-273a-4d75-a8be-d56164e67330 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:01.412829 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d8193456-273a-4d75-a8be-d56164e67330 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:01.413267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d8193456-273a-4d75-a8be-d56164e67330 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:01.416084 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0cdaffbb-601c-419c-a403-5e4d9b5bb68c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:01.423405 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0cdaffbb-601c-419c-a403-5e4d9b5bb68c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.145378 May 17 18:14:01.423974 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 115/225] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:01 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:01.474092 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d8193456-273a-4d75-a8be-d56164e67330 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:01.482259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d8193456-273a-4d75-a8be-d56164e67330 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1346 microversion: 2.1 time: 0.081618 May 17 18:14:01.482850 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 111/226] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:01 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:14:01.901911 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c6e82e00-f10b-4b29-94a3-ac3d01c65cdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:01.902532 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c6e82e00-f10b-4b29-94a3-ac3d01c65cdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:01.908489 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c6e82e00-f10b-4b29-94a3-ac3d01c65cdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:01.908936 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c6e82e00-f10b-4b29-94a3-ac3d01c65cdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:01.909704 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c6e82e00-f10b-4b29-94a3-ac3d01c65cdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:01.910138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c6e82e00-f10b-4b29-94a3-ac3d01c65cdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:02.039826 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c6e82e00-f10b-4b29-94a3-ac3d01c65cdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:02.047240 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c6e82e00-f10b-4b29-94a3-ac3d01c65cdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1319 microversion: 2.1 time: 0.149931 May 17 18:14:02.047807 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 116/227] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:01 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:02.443136 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-86d382f8-db89-4482-b2a9-dd09cfd9f1f6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:02.444447 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-86d382f8-db89-4482-b2a9-dd09cfd9f1f6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:02.453327 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-86d382f8-db89-4482-b2a9-dd09cfd9f1f6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:02.453883 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-86d382f8-db89-4482-b2a9-dd09cfd9f1f6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:02.454767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-86d382f8-db89-4482-b2a9-dd09cfd9f1f6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:02.455283 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-86d382f8-db89-4482-b2a9-dd09cfd9f1f6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:02.498946 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:02.499569 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:02.505501 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:02.505956 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:02.506767 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:02.507767 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:02.540950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:02.541411 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:02.541865 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lazy-loading 'fault' on Instance uuid 87868251-b09f-4394-86e6-728fb6e97a61 {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:14:02.608940 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520132de15345be9472b792965323a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1803826fca42f686f47bd2032828b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:02.614740 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-86d382f8-db89-4482-b2a9-dd09cfd9f1f6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:02.621682 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-642b266f-4534-41e9-869d-bce9d4bb7b6f tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 200 len: 1351 microversion: 2.1 time: 0.126651 May 17 18:14:02.622332 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 117/228] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:02 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:14:02.624022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-86d382f8-db89-4482-b2a9-dd09cfd9f1f6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.186892 May 17 18:14:02.624669 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 112/229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:02 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:02.992144 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-cf0174ed-386f-4cdb-97d6-84633c9d3457 req-d3e443da-7f8b-4a1a-9c23-e6e03d8fa2fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7755ca-b31f-4866-bbad-d9265b908ede", "tag": "07e1d400-b5be-49a9-8446-d004d7659aca"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:14:03.002079 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-cf0174ed-386f-4cdb-97d6-84633c9d3457 req-d3e443da-7f8b-4a1a-9c23-e6e03d8fa2fd service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:03.002548 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-cf0174ed-386f-4cdb-97d6-84633c9d3457 req-d3e443da-7f8b-4a1a-9c23-e6e03d8fa2fd service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:03.014977 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-cf0174ed-386f-4cdb-97d6-84633c9d3457 req-d3e443da-7f8b-4a1a-9c23-e6e03d8fa2fd service nova] Creating event network-changed:07e1d400-b5be-49a9-8446-d004d7659aca for instance bd7755ca-b31f-4866-bbad-d9265b908ede on hv-cinder-84130 May 17 18:14:03.020059 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-cf0174ed-386f-4cdb-97d6-84633c9d3457 req-d3e443da-7f8b-4a1a-9c23-e6e03d8fa2fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032060 May 17 18:14:03.020912 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 118/230] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:14:03.066082 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e77cbdb7-d3df-462a-ab7a-e157d040b05d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:03.066875 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e77cbdb7-d3df-462a-ab7a-e157d040b05d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:03.075851 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e77cbdb7-d3df-462a-ab7a-e157d040b05d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:03.077281 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e77cbdb7-d3df-462a-ab7a-e157d040b05d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:03.078267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e77cbdb7-d3df-462a-ab7a-e157d040b05d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:03.079422 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e77cbdb7-d3df-462a-ab7a-e157d040b05d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:03.259286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e77cbdb7-d3df-462a-ab7a-e157d040b05d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:03.269708 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e77cbdb7-d3df-462a-ab7a-e157d040b05d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1319 microversion: 2.1 time: 0.208332 May 17 18:14:03.270617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 113/231] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:03 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:03.642091 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7eb937e8-fa4b-4f64-a18c-037a7cd1fbef tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:03.642940 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7eb937e8-fa4b-4f64-a18c-037a7cd1fbef tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:03.645293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7d03bdb4-b4dd-473c-8684-ca468735b247 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:03.646554 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7d03bdb4-b4dd-473c-8684-ca468735b247 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:03.650849 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7eb937e8-fa4b-4f64-a18c-037a7cd1fbef tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:03.651579 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7eb937e8-fa4b-4f64-a18c-037a7cd1fbef tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:03.652597 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7eb937e8-fa4b-4f64-a18c-037a7cd1fbef tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:03.653336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7eb937e8-fa4b-4f64-a18c-037a7cd1fbef tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:03.660937 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7d03bdb4-b4dd-473c-8684-ca468735b247 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:03.662092 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7d03bdb4-b4dd-473c-8684-ca468735b247 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:03.663369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7d03bdb4-b4dd-473c-8684-ca468735b247 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:03.664470 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7d03bdb4-b4dd-473c-8684-ca468735b247 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:03.672640 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-7eb937e8-fa4b-4f64-a18c-037a7cd1fbef tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] HTTP exception thrown: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7eb937e8-fa4b-4f64-a18c-037a7cd1fbef tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Request method failure captured: May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 HTTP/1.1 May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-Wbvz3a_Z8LpbO61aBcHDib29XItV6BhK-CqS-EJlt_5hKv0FZmE4CpwAiTdDgHq7Ki-cgrM9wxcmchooMmC0iOEm6BE2ozdefLwJkcEF5xhp_HKkvqeFX_XPJS3z3wyfCSXRRg-7eFgamV2PdrVxiaMrBaXailbaXS4JkYiWPkSGE May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 3e1803826fca42f686f47bd2032828b1 May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-DeleteServersTestJSON-392502493 May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:14:03.677603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e1803826fca42f686f47bd2032828b1", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-DeleteServersTestJSON-392502493 May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 3e1803826fca42f686f47bd2032828b1 May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-DeleteServersTestJSON-392502493 May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-DeleteServersTestJSON-392502493-project May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c520132de15345be9472b792965323a3 May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-DeleteServersTestJSON-392502493-project May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:03.679018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '87868251-b09f-4394-86e6-728fb6e97a61'} May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:14:03.679863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:03.681102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:03.684571 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7eb937e8-fa4b-4f64-a18c-037a7cd1fbef tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Returning 404 to user: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:14:03.685845 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7eb937e8-fa4b-4f64-a18c-037a7cd1fbef tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 404 len: 111 microversion: 2.1 time: 0.049984 May 17 18:14:03.689948 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 119/232] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:03 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:14:03.821010 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5de00b0b-bf05-4fbb-b375-a4207304ce29 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:03.822178 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5de00b0b-bf05-4fbb-b375-a4207304ce29 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:03.828749 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5de00b0b-bf05-4fbb-b375-a4207304ce29 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:03.829547 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5de00b0b-bf05-4fbb-b375-a4207304ce29 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:03.830583 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5de00b0b-bf05-4fbb-b375-a4207304ce29 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:03.831295 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5de00b0b-bf05-4fbb-b375-a4207304ce29 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:03.843544 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7d03bdb4-b4dd-473c-8684-ca468735b247 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:03.845906 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-5de00b0b-bf05-4fbb-b375-a4207304ce29 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] HTTP exception thrown: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5de00b0b-bf05-4fbb-b375-a4207304ce29 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Request method failure captured: May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61/os-volume_attachments HTTP/1.1 May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-Wbvz3a_Z8LpbO61aBcHDib29XItV6BhK-CqS-EJlt_5hKv0FZmE4CpwAiTdDgHq7Ki-cgrM9wxcmchooMmC0iOEm6BE2ozdefLwJkcEF5xhp_HKkvqeFX_XPJS3z3wyfCSXRRg-7eFgamV2PdrVxiaMrBaXailbaXS4JkYiWPkSGE May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 3e1803826fca42f686f47bd2032828b1 May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-DeleteServersTestJSON-392502493 May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:14:03.847736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e1803826fca42f686f47bd2032828b1", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-DeleteServersTestJSON-392502493 May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 3e1803826fca42f686f47bd2032828b1 May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-DeleteServersTestJSON-392502493 May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-DeleteServersTestJSON-392502493-project May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c520132de15345be9472b792965323a3 May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-DeleteServersTestJSON-392502493-project May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:03.849194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'server_id': '87868251-b09f-4394-86e6-728fb6e97a61'} May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:14:03.850011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:03.852206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:03.854129 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5de00b0b-bf05-4fbb-b375-a4207304ce29 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Returning 404 to user: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:14:03.854129 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5de00b0b-bf05-4fbb-b375-a4207304ce29 tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032872 May 17 18:14:03.854129 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 120/233] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:14:03 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:14:03.861011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7d03bdb4-b4dd-473c-8684-ca468735b247 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.221740 May 17 18:14:03.861811 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 114/234] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:03 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:04.294074 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e332838e-1630-40d2-8b59-444197b8a388 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:04.294706 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e332838e-1630-40d2-8b59-444197b8a388 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:04.300574 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e332838e-1630-40d2-8b59-444197b8a388 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:04.301025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e332838e-1630-40d2-8b59-444197b8a388 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:04.301791 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e332838e-1630-40d2-8b59-444197b8a388 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:04.302232 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e332838e-1630-40d2-8b59-444197b8a388 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:04.435354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e332838e-1630-40d2-8b59-444197b8a388 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:04.444202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e332838e-1630-40d2-8b59-444197b8a388 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1319 microversion: 2.1 time: 0.153884 May 17 18:14:04.445512 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 121/235] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:04 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:14:04.877958 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b5bfe5f3-7ce7-4591-be2f-d4aaaf18f37d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:04.878493 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b5bfe5f3-7ce7-4591-be2f-d4aaaf18f37d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:04.885472 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b5bfe5f3-7ce7-4591-be2f-d4aaaf18f37d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:04.885923 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b5bfe5f3-7ce7-4591-be2f-d4aaaf18f37d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:04.886717 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b5bfe5f3-7ce7-4591-be2f-d4aaaf18f37d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:04.887153 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b5bfe5f3-7ce7-4591-be2f-d4aaaf18f37d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:05.018385 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b5bfe5f3-7ce7-4591-be2f-d4aaaf18f37d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:05.026006 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b5bfe5f3-7ce7-4591-be2f-d4aaaf18f37d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.151919 May 17 18:14:05.026589 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 115/236] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:04 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:05.091548 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bdc67765-cf3d-475e-a255-bb160e87aeee tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:05.092044 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-bdc67765-cf3d-475e-a255-bb160e87aeee tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:05.097826 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bdc67765-cf3d-475e-a255-bb160e87aeee tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:05.098277 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bdc67765-cf3d-475e-a255-bb160e87aeee tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:05.099060 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bdc67765-cf3d-475e-a255-bb160e87aeee tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:05.099492 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bdc67765-cf3d-475e-a255-bb160e87aeee tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:05.114524 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-bdc67765-cf3d-475e-a255-bb160e87aeee tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] HTTP exception thrown: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bdc67765-cf3d-475e-a255-bb160e87aeee tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Request method failure captured: May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: DELETE /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 HTTP/1.1 May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-Wbvz3a_Z8LpbO61aBcHDib29XItV6BhK-CqS-EJlt_5hKv0FZmE4CpwAiTdDgHq7Ki-cgrM9wxcmchooMmC0iOEm6BE2ozdefLwJkcEF5xhp_HKkvqeFX_XPJS3z3wyfCSXRRg-7eFgamV2PdrVxiaMrBaXailbaXS4JkYiWPkSGE May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 3e1803826fca42f686f47bd2032828b1 May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-DeleteServersTestJSON-392502493 May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:14:05.116138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e1803826fca42f686f47bd2032828b1", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-DeleteServersTestJSON-392502493 May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 3e1803826fca42f686f47bd2032828b1 May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-DeleteServersTestJSON-392502493 May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-DeleteServersTestJSON-392502493-project May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c520132de15345be9472b792965323a3 May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-DeleteServersTestJSON-392502493-project May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:05.118322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '87868251-b09f-4394-86e6-728fb6e97a61'} May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:14:05.119179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:05.120748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:14:05.122012 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bdc67765-cf3d-475e-a255-bb160e87aeee tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Returning 404 to user: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:14:05.122012 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-bdc67765-cf3d-475e-a255-bb160e87aeee tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "DELETE /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 404 len: 111 microversion: 2.1 time: 0.030299 May 17 18:14:05.122012 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 122/237] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:14:05 2022] DELETE /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:14:05.128381 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-08c0fcf8-f817-4827-ac5c-46b083b3a1ff tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:05.128938 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-08c0fcf8-f817-4827-ac5c-46b083b3a1ff tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] [instance: 87868251-b09f-4394-86e6-728fb6e97a61] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:05.135407 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08c0fcf8-f817-4827-ac5c-46b083b3a1ff tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:05.135854 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08c0fcf8-f817-4827-ac5c-46b083b3a1ff tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:05.136626 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08c0fcf8-f817-4827-ac5c-46b083b3a1ff tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:05.137063 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08c0fcf8-f817-4827-ac5c-46b083b3a1ff tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:05.150267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-08c0fcf8-f817-4827-ac5c-46b083b3a1ff tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] HTTP exception thrown: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-08c0fcf8-f817-4827-ac5c-46b083b3a1ff tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Request method failure captured: May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 HTTP/1.1 May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-Wbvz3a_Z8LpbO61aBcHDib29XItV6BhK-CqS-EJlt_5hKv0FZmE4CpwAiTdDgHq7Ki-cgrM9wxcmchooMmC0iOEm6BE2ozdefLwJkcEF5xhp_HKkvqeFX_XPJS3z3wyfCSXRRg-7eFgamV2PdrVxiaMrBaXailbaXS4JkYiWPkSGE May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 3e1803826fca42f686f47bd2032828b1 May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-DeleteServersTestJSON-392502493 May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:14:05.154828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e1803826fca42f686f47bd2032828b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e1803826fca42f686f47bd2032828b1", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-DeleteServersTestJSON-392502493 May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 3e1803826fca42f686f47bd2032828b1 May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-DeleteServersTestJSON-392502493 May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-DeleteServersTestJSON-392502493-project May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c520132de15345be9472b792965323a3 May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-DeleteServersTestJSON-392502493-project May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:05.156320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '87868251-b09f-4394-86e6-728fb6e97a61'} May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:14:05.157198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. May 17 18:14:05.158631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:14:05.160419 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-08c0fcf8-f817-4827-ac5c-46b083b3a1ff tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] Returning 404 to user: Instance 87868251-b09f-4394-86e6-728fb6e97a61 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:14:05.160419 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-08c0fcf8-f817-4827-ac5c-46b083b3a1ff tempest-DeleteServersTestJSON-392502493 tempest-DeleteServersTestJSON-392502493-project] 10.222.0.25 "GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61" status: 404 len: 111 microversion: 2.1 time: 0.031901 May 17 18:14:05.160419 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 116/238] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:05 2022] GET /compute/v2.1/servers/87868251-b09f-4394-86e6-728fb6e97a61 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:14:05.461090 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-85e28ac7-9244-4fa8-ad32-cb8d3f6ca097 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:05.462134 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-85e28ac7-9244-4fa8-ad32-cb8d3f6ca097 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:05.468612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-85e28ac7-9244-4fa8-ad32-cb8d3f6ca097 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:05.469356 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-85e28ac7-9244-4fa8-ad32-cb8d3f6ca097 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:05.470358 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-85e28ac7-9244-4fa8-ad32-cb8d3f6ca097 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:05.470892 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-85e28ac7-9244-4fa8-ad32-cb8d3f6ca097 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:05.825892 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-85e28ac7-9244-4fa8-ad32-cb8d3f6ca097 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:05.836266 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-85e28ac7-9244-4fa8-ad32-cb8d3f6ca097 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1319 microversion: 2.1 time: 0.377957 May 17 18:14:05.838353 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 123/239] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:05 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:06.043553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-89bc42c5-11d3-4b3f-9d83-792b0de1566a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:06.045620 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-89bc42c5-11d3-4b3f-9d83-792b0de1566a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:06.052681 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-89bc42c5-11d3-4b3f-9d83-792b0de1566a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:06.054643 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-89bc42c5-11d3-4b3f-9d83-792b0de1566a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:06.055590 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-89bc42c5-11d3-4b3f-9d83-792b0de1566a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:06.056175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-89bc42c5-11d3-4b3f-9d83-792b0de1566a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:06.249245 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-89bc42c5-11d3-4b3f-9d83-792b0de1566a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:06.257965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-89bc42c5-11d3-4b3f-9d83-792b0de1566a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.219854 May 17 18:14:06.258881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 117/240] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:06 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:06.854473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a981e96f-f605-4004-84d9-2257bbcd3583 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:06.855219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a981e96f-f605-4004-84d9-2257bbcd3583 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:06.862320 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a981e96f-f605-4004-84d9-2257bbcd3583 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:06.862872 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a981e96f-f605-4004-84d9-2257bbcd3583 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:06.863875 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a981e96f-f605-4004-84d9-2257bbcd3583 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:06.864558 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a981e96f-f605-4004-84d9-2257bbcd3583 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:07.024201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a981e96f-f605-4004-84d9-2257bbcd3583 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:07.034290 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a981e96f-f605-4004-84d9-2257bbcd3583 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1319 microversion: 2.1 time: 0.184405 May 17 18:14:07.035060 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 124/241] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:06 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:07.275492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-014a94c9-1aa6-47fe-9ae4-a798c51122e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:07.276191 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-014a94c9-1aa6-47fe-9ae4-a798c51122e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:07.282252 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-014a94c9-1aa6-47fe-9ae4-a798c51122e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:07.282802 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-014a94c9-1aa6-47fe-9ae4-a798c51122e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:07.283832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-014a94c9-1aa6-47fe-9ae4-a798c51122e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:07.285054 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-014a94c9-1aa6-47fe-9ae4-a798c51122e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:07.444920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-014a94c9-1aa6-47fe-9ae4-a798c51122e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:07.459410 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-014a94c9-1aa6-47fe-9ae4-a798c51122e3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.188098 May 17 18:14:07.459983 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 118/242] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:07 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:08.034689 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-3a9b8841-76bd-4083-82e8-a42e241f43b8 req-1ff2dd53-49b3-4794-9055-a86a4cada572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7755ca-b31f-4866-bbad-d9265b908ede", "name": "network-vif-plugged", "status": "completed", "tag": "07e1d400-b5be-49a9-8446-d004d7659aca"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:14:08.046626 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-3a9b8841-76bd-4083-82e8-a42e241f43b8 req-1ff2dd53-49b3-4794-9055-a86a4cada572 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:08.047429 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-3a9b8841-76bd-4083-82e8-a42e241f43b8 req-1ff2dd53-49b3-4794-9055-a86a4cada572 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:08.052652 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-347105ca-50bc-4742-9235-40e237e489fc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:08.053359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-347105ca-50bc-4742-9235-40e237e489fc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:08.060186 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-347105ca-50bc-4742-9235-40e237e489fc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:08.061252 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-347105ca-50bc-4742-9235-40e237e489fc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:08.062557 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-347105ca-50bc-4742-9235-40e237e489fc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:08.063433 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-347105ca-50bc-4742-9235-40e237e489fc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:08.064285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-3a9b8841-76bd-4083-82e8-a42e241f43b8 req-1ff2dd53-49b3-4794-9055-a86a4cada572 service nova] Creating event network-vif-plugged:07e1d400-b5be-49a9-8446-d004d7659aca for instance bd7755ca-b31f-4866-bbad-d9265b908ede on hv-cinder-84130 May 17 18:14:08.075410 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-3a9b8841-76bd-4083-82e8-a42e241f43b8 req-1ff2dd53-49b3-4794-9055-a86a4cada572 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047699 May 17 18:14:08.077038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 125/243] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:14:08.283871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-347105ca-50bc-4742-9235-40e237e489fc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:08.299365 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-347105ca-50bc-4742-9235-40e237e489fc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1319 microversion: 2.1 time: 0.250211 May 17 18:14:08.301019 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 119/244] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:08 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:08.478946 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6bea0162-1ed8-480c-8a26-f33e3453fb33 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:08.479651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6bea0162-1ed8-480c-8a26-f33e3453fb33 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:08.486329 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6bea0162-1ed8-480c-8a26-f33e3453fb33 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:08.486818 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6bea0162-1ed8-480c-8a26-f33e3453fb33 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:08.487777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6bea0162-1ed8-480c-8a26-f33e3453fb33 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:08.488231 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6bea0162-1ed8-480c-8a26-f33e3453fb33 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:08.661025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6bea0162-1ed8-480c-8a26-f33e3453fb33 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:08.670268 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6bea0162-1ed8-480c-8a26-f33e3453fb33 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.196378 May 17 18:14:08.670882 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 126/245] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:08 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:09.317030 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-64033f59-b390-464d-93fd-891fecda9378 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:09.317910 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-64033f59-b390-464d-93fd-891fecda9378 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:09.324458 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-64033f59-b390-464d-93fd-891fecda9378 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:09.324910 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-64033f59-b390-464d-93fd-891fecda9378 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:09.325679 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-64033f59-b390-464d-93fd-891fecda9378 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:09.326119 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-64033f59-b390-464d-93fd-891fecda9378 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:09.473060 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-64033f59-b390-464d-93fd-891fecda9378 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:09.483369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-64033f59-b390-464d-93fd-891fecda9378 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1319 microversion: 2.1 time: 0.169898 May 17 18:14:09.485541 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 120/246] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:09 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:09.688431 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f2cd5e70-6200-4df4-849e-f09350160011 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:09.689679 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f2cd5e70-6200-4df4-849e-f09350160011 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:09.696899 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f2cd5e70-6200-4df4-849e-f09350160011 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:09.697567 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f2cd5e70-6200-4df4-849e-f09350160011 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:09.698345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f2cd5e70-6200-4df4-849e-f09350160011 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:09.698820 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f2cd5e70-6200-4df4-849e-f09350160011 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:09.874034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f2cd5e70-6200-4df4-849e-f09350160011 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:09.881560 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f2cd5e70-6200-4df4-849e-f09350160011 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.196979 May 17 18:14:09.883373 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 127/247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:09 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:10.500488 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-85b538f1-1d22-4c1a-8245-bedd9f976cb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:10.501116 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-85b538f1-1d22-4c1a-8245-bedd9f976cb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:10.507692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-85b538f1-1d22-4c1a-8245-bedd9f976cb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:10.508361 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-85b538f1-1d22-4c1a-8245-bedd9f976cb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:10.509173 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-85b538f1-1d22-4c1a-8245-bedd9f976cb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:10.509599 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-85b538f1-1d22-4c1a-8245-bedd9f976cb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:10.646955 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-85b538f1-1d22-4c1a-8245-bedd9f976cb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:10.654944 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-85b538f1-1d22-4c1a-8245-bedd9f976cb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1507 microversion: 2.1 time: 0.158256 May 17 18:14:10.655521 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 121/248] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:10 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:10.903243 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b7fbbe02-94a2-4258-b049-49f81c0ad819 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:10.904481 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b7fbbe02-94a2-4258-b049-49f81c0ad819 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:10.910639 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7fbbe02-94a2-4258-b049-49f81c0ad819 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:10.911471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7fbbe02-94a2-4258-b049-49f81c0ad819 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:10.912395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7fbbe02-94a2-4258-b049-49f81c0ad819 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:10.912987 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7fbbe02-94a2-4258-b049-49f81c0ad819 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:11.083916 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b7fbbe02-94a2-4258-b049-49f81c0ad819 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:11.092315 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b7fbbe02-94a2-4258-b049-49f81c0ad819 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.192938 May 17 18:14:11.092990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 128/249] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:10 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:12.111371 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-07cd8d7e-4f49-4bb6-9020-a1d64c4494c8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:12.111989 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-07cd8d7e-4f49-4bb6-9020-a1d64c4494c8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:12.119194 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-07cd8d7e-4f49-4bb6-9020-a1d64c4494c8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:12.119864 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-07cd8d7e-4f49-4bb6-9020-a1d64c4494c8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:12.120639 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-07cd8d7e-4f49-4bb6-9020-a1d64c4494c8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:12.121159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-07cd8d7e-4f49-4bb6-9020-a1d64c4494c8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:12.319167 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-07cd8d7e-4f49-4bb6-9020-a1d64c4494c8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:12.328924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-07cd8d7e-4f49-4bb6-9020-a1d64c4494c8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.221030 May 17 18:14:12.329481 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 122/250] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:12 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:13.345574 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7ff9d354-ccfa-4eaa-bed4-8d203b363e5e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:13.346201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7ff9d354-ccfa-4eaa-bed4-8d203b363e5e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:13.352738 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7ff9d354-ccfa-4eaa-bed4-8d203b363e5e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:13.361652 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7ff9d354-ccfa-4eaa-bed4-8d203b363e5e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:13.361652 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7ff9d354-ccfa-4eaa-bed4-8d203b363e5e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:13.361652 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7ff9d354-ccfa-4eaa-bed4-8d203b363e5e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:13.486368 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7ff9d354-ccfa-4eaa-bed4-8d203b363e5e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:13.496411 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7ff9d354-ccfa-4eaa-bed4-8d203b363e5e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.152528 May 17 18:14:13.504171 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 129/251] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:13 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:14.511637 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f29db88e-6966-4756-92d1-1b28fd9f9bb9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:14.513162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f29db88e-6966-4756-92d1-1b28fd9f9bb9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:14.525684 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f29db88e-6966-4756-92d1-1b28fd9f9bb9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:14.526721 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f29db88e-6966-4756-92d1-1b28fd9f9bb9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:14.527756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f29db88e-6966-4756-92d1-1b28fd9f9bb9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:14.528374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f29db88e-6966-4756-92d1-1b28fd9f9bb9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:14.859488 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f29db88e-6966-4756-92d1-1b28fd9f9bb9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:14.867607 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f29db88e-6966-4756-92d1-1b28fd9f9bb9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.359677 May 17 18:14:14.868400 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 123/252] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:14 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:15.883831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9f6fbd9b-a234-48d6-91c0-4108e17f4868 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:15.884518 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9f6fbd9b-a234-48d6-91c0-4108e17f4868 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:15.891057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9f6fbd9b-a234-48d6-91c0-4108e17f4868 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:15.891581 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9f6fbd9b-a234-48d6-91c0-4108e17f4868 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:15.892588 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9f6fbd9b-a234-48d6-91c0-4108e17f4868 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:15.893289 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9f6fbd9b-a234-48d6-91c0-4108e17f4868 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:16.041661 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9f6fbd9b-a234-48d6-91c0-4108e17f4868 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:16.050275 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9f6fbd9b-a234-48d6-91c0-4108e17f4868 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.170341 May 17 18:14:16.051258 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 130/253] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:15 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:17.067258 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7b8618d0-e723-4cae-b29a-a06088280b0b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:17.068245 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7b8618d0-e723-4cae-b29a-a06088280b0b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:17.075698 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7b8618d0-e723-4cae-b29a-a06088280b0b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:17.076161 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7b8618d0-e723-4cae-b29a-a06088280b0b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:17.076937 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7b8618d0-e723-4cae-b29a-a06088280b0b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:17.077379 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7b8618d0-e723-4cae-b29a-a06088280b0b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:17.210473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7b8618d0-e723-4cae-b29a-a06088280b0b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:17.217841 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7b8618d0-e723-4cae-b29a-a06088280b0b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.154555 May 17 18:14:17.218407 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 124/254] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:17 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:18.236809 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f0c820c2-8aa8-4125-8be1-c6dfc59d4f66 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:18.238125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f0c820c2-8aa8-4125-8be1-c6dfc59d4f66 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:18.245524 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0c820c2-8aa8-4125-8be1-c6dfc59d4f66 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:18.246013 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0c820c2-8aa8-4125-8be1-c6dfc59d4f66 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:18.246911 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0c820c2-8aa8-4125-8be1-c6dfc59d4f66 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:18.247607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0c820c2-8aa8-4125-8be1-c6dfc59d4f66 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:18.397677 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f0c820c2-8aa8-4125-8be1-c6dfc59d4f66 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:18.405277 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f0c820c2-8aa8-4125-8be1-c6dfc59d4f66 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.173009 May 17 18:14:18.405846 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 131/255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:18 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:19.422643 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-687412fd-3585-4d93-a330-b062947566b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:19.423262 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-687412fd-3585-4d93-a330-b062947566b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:19.429802 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-687412fd-3585-4d93-a330-b062947566b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:19.430253 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-687412fd-3585-4d93-a330-b062947566b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:19.431051 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-687412fd-3585-4d93-a330-b062947566b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:19.431487 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-687412fd-3585-4d93-a330-b062947566b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:19.571204 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-687412fd-3585-4d93-a330-b062947566b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:19.579027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-687412fd-3585-4d93-a330-b062947566b7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.160082 May 17 18:14:19.579760 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 125/256] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:19 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:14:20.596456 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9fd930dc-84a5-4458-be16-28182fa6449c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:20.597081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9fd930dc-84a5-4458-be16-28182fa6449c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:20.603902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9fd930dc-84a5-4458-be16-28182fa6449c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:20.604354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9fd930dc-84a5-4458-be16-28182fa6449c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:20.605119 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9fd930dc-84a5-4458-be16-28182fa6449c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:20.605556 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9fd930dc-84a5-4458-be16-28182fa6449c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:20.762770 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9fd930dc-84a5-4458-be16-28182fa6449c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:20.770308 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9fd930dc-84a5-4458-be16-28182fa6449c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.178117 May 17 18:14:20.770895 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 132/257] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:20 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:21.787275 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1320b778-c705-4992-9719-4922f367196b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:21.787780 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1320b778-c705-4992-9719-4922f367196b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:21.794346 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1320b778-c705-4992-9719-4922f367196b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:21.794836 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1320b778-c705-4992-9719-4922f367196b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:21.795608 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1320b778-c705-4992-9719-4922f367196b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:21.796050 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1320b778-c705-4992-9719-4922f367196b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:21.928713 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1320b778-c705-4992-9719-4922f367196b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:21.942748 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1320b778-c705-4992-9719-4922f367196b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.158778 May 17 18:14:21.943215 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 126/258] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:21 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:22.961278 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-faabd0f4-1ad8-4675-8bcb-4adbe4e4c290 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:22.962059 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-faabd0f4-1ad8-4675-8bcb-4adbe4e4c290 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:22.967924 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-faabd0f4-1ad8-4675-8bcb-4adbe4e4c290 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:22.968406 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-faabd0f4-1ad8-4675-8bcb-4adbe4e4c290 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:22.969165 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-faabd0f4-1ad8-4675-8bcb-4adbe4e4c290 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:22.969598 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-faabd0f4-1ad8-4675-8bcb-4adbe4e4c290 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:23.103324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-faabd0f4-1ad8-4675-8bcb-4adbe4e4c290 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:23.110837 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-faabd0f4-1ad8-4675-8bcb-4adbe4e4c290 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.153419 May 17 18:14:23.111449 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 133/259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:22 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:24.128239 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d4ca5841-cc34-437e-a05e-48a672b1f526 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:24.129070 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d4ca5841-cc34-437e-a05e-48a672b1f526 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:24.136313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4ca5841-cc34-437e-a05e-48a672b1f526 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:24.136771 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4ca5841-cc34-437e-a05e-48a672b1f526 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:24.137745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4ca5841-cc34-437e-a05e-48a672b1f526 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:24.138178 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4ca5841-cc34-437e-a05e-48a672b1f526 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:24.286136 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d4ca5841-cc34-437e-a05e-48a672b1f526 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:24.294156 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d4ca5841-cc34-437e-a05e-48a672b1f526 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.170016 May 17 18:14:24.294791 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 127/260] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:24 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:25.310680 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d81fa5a3-4ec3-4ce6-ba27-02062d5ebf44 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:25.311481 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d81fa5a3-4ec3-4ce6-ba27-02062d5ebf44 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:25.317302 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d81fa5a3-4ec3-4ce6-ba27-02062d5ebf44 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:25.318027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d81fa5a3-4ec3-4ce6-ba27-02062d5ebf44 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:25.318845 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d81fa5a3-4ec3-4ce6-ba27-02062d5ebf44 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:25.319285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d81fa5a3-4ec3-4ce6-ba27-02062d5ebf44 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:25.456341 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d81fa5a3-4ec3-4ce6-ba27-02062d5ebf44 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:25.463815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d81fa5a3-4ec3-4ce6-ba27-02062d5ebf44 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.157022 May 17 18:14:25.464529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 134/261] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:25 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:26.480960 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-afb50ecb-8c20-4919-8a6f-e1a74da142d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:26.481622 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-afb50ecb-8c20-4919-8a6f-e1a74da142d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:26.487952 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-afb50ecb-8c20-4919-8a6f-e1a74da142d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:26.488408 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-afb50ecb-8c20-4919-8a6f-e1a74da142d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:26.489468 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-afb50ecb-8c20-4919-8a6f-e1a74da142d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:26.489874 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-afb50ecb-8c20-4919-8a6f-e1a74da142d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:26.626817 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-afb50ecb-8c20-4919-8a6f-e1a74da142d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:26.634886 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-afb50ecb-8c20-4919-8a6f-e1a74da142d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.158915 May 17 18:14:26.635537 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 128/262] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:26 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:27.652990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b57a3bb3-c0a8-4921-9e37-e10e3fa31839 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:27.653600 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b57a3bb3-c0a8-4921-9e37-e10e3fa31839 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:27.660686 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b57a3bb3-c0a8-4921-9e37-e10e3fa31839 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:27.661251 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b57a3bb3-c0a8-4921-9e37-e10e3fa31839 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:27.662139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b57a3bb3-c0a8-4921-9e37-e10e3fa31839 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:27.663109 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b57a3bb3-c0a8-4921-9e37-e10e3fa31839 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:27.827509 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b57a3bb3-c0a8-4921-9e37-e10e3fa31839 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:27.835695 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b57a3bb3-c0a8-4921-9e37-e10e3fa31839 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.186914 May 17 18:14:27.836975 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 135/263] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:27 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:28.854196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5f4c3ab3-c475-47c4-97d8-10c3fb59c54c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:28.856305 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5f4c3ab3-c475-47c4-97d8-10c3fb59c54c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:28.869094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f4c3ab3-c475-47c4-97d8-10c3fb59c54c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:28.869725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f4c3ab3-c475-47c4-97d8-10c3fb59c54c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:28.871178 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f4c3ab3-c475-47c4-97d8-10c3fb59c54c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:28.871746 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f4c3ab3-c475-47c4-97d8-10c3fb59c54c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:29.007060 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5f4c3ab3-c475-47c4-97d8-10c3fb59c54c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:29.014634 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5f4c3ab3-c475-47c4-97d8-10c3fb59c54c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1522 microversion: 2.1 time: 0.165345 May 17 18:14:29.015201 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 129/264] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:28 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:30.030992 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1a9b69a6-0fff-49ce-80ec-1ff7e6e2d14a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:30.031599 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1a9b69a6-0fff-49ce-80ec-1ff7e6e2d14a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:30.041443 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1a9b69a6-0fff-49ce-80ec-1ff7e6e2d14a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:30.041900 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1a9b69a6-0fff-49ce-80ec-1ff7e6e2d14a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:30.042738 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1a9b69a6-0fff-49ce-80ec-1ff7e6e2d14a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:30.043177 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1a9b69a6-0fff-49ce-80ec-1ff7e6e2d14a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:30.250414 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1a9b69a6-0fff-49ce-80ec-1ff7e6e2d14a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:30.261926 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1a9b69a6-0fff-49ce-80ec-1ff7e6e2d14a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1502 microversion: 2.1 time: 0.234555 May 17 18:14:30.262959 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 136/265] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:30 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:30.280810 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-54bf5857-0f8d-42ce-bbfd-7d70d2da52be tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:30.281588 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-54bf5857-0f8d-42ce-bbfd-7d70d2da52be tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:30.289169 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-54bf5857-0f8d-42ce-bbfd-7d70d2da52be tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:30.290868 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-54bf5857-0f8d-42ce-bbfd-7d70d2da52be tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:30.291705 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-54bf5857-0f8d-42ce-bbfd-7d70d2da52be tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:30.292149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-54bf5857-0f8d-42ce-bbfd-7d70d2da52be tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:30.427676 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-54bf5857-0f8d-42ce-bbfd-7d70d2da52be tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:30.436018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-54bf5857-0f8d-42ce-bbfd-7d70d2da52be tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1516 microversion: 2.1 time: 0.159228 May 17 18:14:30.436614 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 130/266] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:30 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:31.813624 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4e5f77e8-25d5-4d42-b6df-135569550688 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:14:31.814755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4e5f77e8-25d5-4d42-b6df-135569550688 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:31.821117 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4e5f77e8-25d5-4d42-b6df-135569550688 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:31.821759 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4e5f77e8-25d5-4d42-b6df-135569550688 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:31.822526 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4e5f77e8-25d5-4d42-b6df-135569550688 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:31.822993 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4e5f77e8-25d5-4d42-b6df-135569550688 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:31.845386 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-4e5f77e8-25d5-4d42-b6df-135569550688 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lazy-loading 'flavor' on Instance uuid 530a3eb3-cd60-4f22-a693-6221a19eea5f {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:14:31.922364 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4e5f77e8-25d5-4d42-b6df-135569550688 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f/action" status: 200 len: 32 microversion: 2.1 time: 0.113482 May 17 18:14:31.923513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 137/267] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:14:31 2022] POST /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f/action => generated 32 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:14:31.937957 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0e9855d6-7435-4219-9f8d-f028cdc803fd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:31.940238 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0e9855d6-7435-4219-9f8d-f028cdc803fd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:31.954101 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e9855d6-7435-4219-9f8d-f028cdc803fd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:31.954683 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e9855d6-7435-4219-9f8d-f028cdc803fd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:31.955496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e9855d6-7435-4219-9f8d-f028cdc803fd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:31.955932 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e9855d6-7435-4219-9f8d-f028cdc803fd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:32.119581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0e9855d6-7435-4219-9f8d-f028cdc803fd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:32.127243 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0e9855d6-7435-4219-9f8d-f028cdc803fd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.194783 May 17 18:14:32.127887 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 131/268] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:31 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:33.146304 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fd2cda2b-11fd-472c-9609-eee2129caa93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:33.147033 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fd2cda2b-11fd-472c-9609-eee2129caa93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:33.154047 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fd2cda2b-11fd-472c-9609-eee2129caa93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:33.154556 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fd2cda2b-11fd-472c-9609-eee2129caa93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:33.155480 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fd2cda2b-11fd-472c-9609-eee2129caa93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:33.155908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fd2cda2b-11fd-472c-9609-eee2129caa93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:33.312899 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-fd2cda2b-11fd-472c-9609-eee2129caa93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:33.322423 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fd2cda2b-11fd-472c-9609-eee2129caa93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.180520 May 17 18:14:33.332103 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 138/269] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:33 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:34.340145 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d4ed9848-f864-447a-b8cf-8a210c1ba417 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:34.340786 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d4ed9848-f864-447a-b8cf-8a210c1ba417 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:34.347480 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4ed9848-f864-447a-b8cf-8a210c1ba417 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:34.347962 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4ed9848-f864-447a-b8cf-8a210c1ba417 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:34.348736 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4ed9848-f864-447a-b8cf-8a210c1ba417 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:34.349180 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4ed9848-f864-447a-b8cf-8a210c1ba417 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:34.492123 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d4ed9848-f864-447a-b8cf-8a210c1ba417 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:34.500801 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d4ed9848-f864-447a-b8cf-8a210c1ba417 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.165000 May 17 18:14:34.501370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 132/270] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:34 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:34.919324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1001c6f8-2501-4edf-bc37-ec4a0aa1493f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:34.920365 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1001c6f8-2501-4edf-bc37-ec4a0aa1493f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:34.928843 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1001c6f8-2501-4edf-bc37-ec4a0aa1493f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:34.929509 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1001c6f8-2501-4edf-bc37-ec4a0aa1493f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:34.932004 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1001c6f8-2501-4edf-bc37-ec4a0aa1493f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:34.932680 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1001c6f8-2501-4edf-bc37-ec4a0aa1493f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:34.968718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1001c6f8-2501-4edf-bc37-ec4a0aa1493f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/ips" status: 200 len: 147 microversion: 2.1 time: 0.055093 May 17 18:14:34.974422 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 139/271] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 17 18:14:34 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/ips => generated 147 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:14:35.518874 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fa2fc03a-1dae-4e9d-8c70-8604bf1ac84e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:35.519392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-fa2fc03a-1dae-4e9d-8c70-8604bf1ac84e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:35.527035 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fa2fc03a-1dae-4e9d-8c70-8604bf1ac84e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:35.527487 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fa2fc03a-1dae-4e9d-8c70-8604bf1ac84e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:35.528269 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fa2fc03a-1dae-4e9d-8c70-8604bf1ac84e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:35.528717 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fa2fc03a-1dae-4e9d-8c70-8604bf1ac84e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:35.658867 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-fa2fc03a-1dae-4e9d-8c70-8604bf1ac84e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:35.666261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-fa2fc03a-1dae-4e9d-8c70-8604bf1ac84e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.151999 May 17 18:14:35.666862 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 133/272] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:35 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:36.683257 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4e453455-f475-4d97-98b4-90eba4b08b62 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:36.683871 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4e453455-f475-4d97-98b4-90eba4b08b62 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:36.689698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4e453455-f475-4d97-98b4-90eba4b08b62 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:36.690154 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4e453455-f475-4d97-98b4-90eba4b08b62 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:36.690951 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4e453455-f475-4d97-98b4-90eba4b08b62 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:36.691397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4e453455-f475-4d97-98b4-90eba4b08b62 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:36.818937 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4e453455-f475-4d97-98b4-90eba4b08b62 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:36.826329 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4e453455-f475-4d97-98b4-90eba4b08b62 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.147200 May 17 18:14:36.826932 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 140/273] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:36 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:37.845300 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-447d6bb6-dc32-44e8-aefe-d16481bcb2c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:37.846091 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-447d6bb6-dc32-44e8-aefe-d16481bcb2c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:37.852766 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-447d6bb6-dc32-44e8-aefe-d16481bcb2c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:37.853208 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-447d6bb6-dc32-44e8-aefe-d16481bcb2c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:37.854173 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-447d6bb6-dc32-44e8-aefe-d16481bcb2c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:37.854715 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-447d6bb6-dc32-44e8-aefe-d16481bcb2c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:38.005226 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-447d6bb6-dc32-44e8-aefe-d16481bcb2c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:38.012751 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-447d6bb6-dc32-44e8-aefe-d16481bcb2c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.171270 May 17 18:14:38.013325 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 134/274] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:37 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:38.621591 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-dcb42035-b39f-4fc3-92b8-afce95978769 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29667064-9bd2-4c14-917f-3fee87871b40", "device": "/dev/sdb"}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:14:38.623402 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-dcb42035-b39f-4fc3-92b8-afce95978769 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:38.629629 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dcb42035-b39f-4fc3-92b8-afce95978769 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:38.630182 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dcb42035-b39f-4fc3-92b8-afce95978769 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:38.630998 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dcb42035-b39f-4fc3-92b8-afce95978769 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:38.631443 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dcb42035-b39f-4fc3-92b8-afce95978769 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:38.848909 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-47c5920c-9843-4ac7-93ef-4f5476fddc78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e7af98d-cebc-41b5-af99-7f078acd2119"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:14:38.850800 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-47c5920c-9843-4ac7-93ef-4f5476fddc78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:38.858251 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-47c5920c-9843-4ac7-93ef-4f5476fddc78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:38.859342 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-47c5920c-9843-4ac7-93ef-4f5476fddc78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:38.860300 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-47c5920c-9843-4ac7-93ef-4f5476fddc78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:38.860789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-47c5920c-9843-4ac7-93ef-4f5476fddc78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:38.978470 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-dcb42035-b39f-4fc3-92b8-afce95978769 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "POST /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361600 May 17 18:14:38.984380 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 141/275] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:14:38 2022] POST /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:14:39.033692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-beb259ec-ed7a-4064-9da5-8fcd6951eb1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:39.034625 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-beb259ec-ed7a-4064-9da5-8fcd6951eb1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:39.043928 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-beb259ec-ed7a-4064-9da5-8fcd6951eb1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:39.044436 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-beb259ec-ed7a-4064-9da5-8fcd6951eb1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:39.045593 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-beb259ec-ed7a-4064-9da5-8fcd6951eb1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:39.046267 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-beb259ec-ed7a-4064-9da5-8fcd6951eb1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:39.247078 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-47c5920c-9843-4ac7-93ef-4f5476fddc78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402296 May 17 18:14:39.248586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 135/276] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:14:38 2022] POST /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:14:39.255962 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-beb259ec-ed7a-4064-9da5-8fcd6951eb1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:39.265461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-beb259ec-ed7a-4064-9da5-8fcd6951eb1c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.239734 May 17 18:14:39.270817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 142/277] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:39 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:14:40.294798 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b8db6da3-b964-4043-9b99-ce80785d6f4f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:40.295505 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b8db6da3-b964-4043-9b99-ce80785d6f4f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:40.302278 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b8db6da3-b964-4043-9b99-ce80785d6f4f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:40.302785 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b8db6da3-b964-4043-9b99-ce80785d6f4f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:40.304203 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b8db6da3-b964-4043-9b99-ce80785d6f4f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:40.304647 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b8db6da3-b964-4043-9b99-ce80785d6f4f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:40.492383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b8db6da3-b964-4043-9b99-ce80785d6f4f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:40.501444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b8db6da3-b964-4043-9b99-ce80785d6f4f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.211497 May 17 18:14:40.502210 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 136/278] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:40 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:41.523607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8395e8f1-b9a7-4214-8e51-6c81af7f0079 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:41.524309 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8395e8f1-b9a7-4214-8e51-6c81af7f0079 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:41.530989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8395e8f1-b9a7-4214-8e51-6c81af7f0079 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:41.531435 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8395e8f1-b9a7-4214-8e51-6c81af7f0079 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:41.532472 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8395e8f1-b9a7-4214-8e51-6c81af7f0079 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:41.532654 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8395e8f1-b9a7-4214-8e51-6c81af7f0079 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:41.677038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8395e8f1-b9a7-4214-8e51-6c81af7f0079 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:41.685137 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8395e8f1-b9a7-4214-8e51-6c81af7f0079 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.165721 May 17 18:14:41.685710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 143/279] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:41 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:42.702883 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ff90150f-175f-454f-8d1d-f8401a0a733c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:42.703512 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ff90150f-175f-454f-8d1d-f8401a0a733c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:42.709805 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ff90150f-175f-454f-8d1d-f8401a0a733c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:42.710259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ff90150f-175f-454f-8d1d-f8401a0a733c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:42.711094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ff90150f-175f-454f-8d1d-f8401a0a733c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:42.711570 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ff90150f-175f-454f-8d1d-f8401a0a733c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:42.845045 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ff90150f-175f-454f-8d1d-f8401a0a733c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:42.853129 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ff90150f-175f-454f-8d1d-f8401a0a733c tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.154154 May 17 18:14:42.853760 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 137/280] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:42 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:43.871336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-51cb9d71-d1b2-477d-97a2-4d700a83a0c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:43.871893 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-51cb9d71-d1b2-477d-97a2-4d700a83a0c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:43.878762 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-51cb9d71-d1b2-477d-97a2-4d700a83a0c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:43.879219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-51cb9d71-d1b2-477d-97a2-4d700a83a0c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:43.879996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-51cb9d71-d1b2-477d-97a2-4d700a83a0c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:43.880436 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-51cb9d71-d1b2-477d-97a2-4d700a83a0c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:44.013832 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-51cb9d71-d1b2-477d-97a2-4d700a83a0c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:44.021380 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-51cb9d71-d1b2-477d-97a2-4d700a83a0c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.154710 May 17 18:14:44.021957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 144/281] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:43 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:45.039386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-cf22d615-8603-4ec3-9041-90fc2b319c3d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:45.040008 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-cf22d615-8603-4ec3-9041-90fc2b319c3d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:45.047467 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cf22d615-8603-4ec3-9041-90fc2b319c3d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:45.047924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cf22d615-8603-4ec3-9041-90fc2b319c3d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:45.048713 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cf22d615-8603-4ec3-9041-90fc2b319c3d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:45.049160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cf22d615-8603-4ec3-9041-90fc2b319c3d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:45.195405 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-cf22d615-8603-4ec3-9041-90fc2b319c3d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:45.204405 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-cf22d615-8603-4ec3-9041-90fc2b319c3d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.168776 May 17 18:14:45.205251 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 138/282] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:45 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:46.223498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-867597dc-9058-41f2-8543-aa0bbbe04f94 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:46.224218 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-867597dc-9058-41f2-8543-aa0bbbe04f94 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:46.232672 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-867597dc-9058-41f2-8543-aa0bbbe04f94 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:46.233131 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-867597dc-9058-41f2-8543-aa0bbbe04f94 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:46.233908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-867597dc-9058-41f2-8543-aa0bbbe04f94 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:46.234350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-867597dc-9058-41f2-8543-aa0bbbe04f94 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:46.377990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-867597dc-9058-41f2-8543-aa0bbbe04f94 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:46.387582 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-867597dc-9058-41f2-8543-aa0bbbe04f94 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.168595 May 17 18:14:46.389155 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 145/283] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:46 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:47.405133 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a848a96b-68a9-4e1b-987d-c7186825bacc tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:47.405743 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a848a96b-68a9-4e1b-987d-c7186825bacc tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:47.412073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a848a96b-68a9-4e1b-987d-c7186825bacc tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:47.412525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a848a96b-68a9-4e1b-987d-c7186825bacc tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:47.413283 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a848a96b-68a9-4e1b-987d-c7186825bacc tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:47.413719 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a848a96b-68a9-4e1b-987d-c7186825bacc tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:47.551608 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a848a96b-68a9-4e1b-987d-c7186825bacc tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:47.560376 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a848a96b-68a9-4e1b-987d-c7186825bacc tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.159081 May 17 18:14:47.560954 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 139/284] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:47 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:47.744525 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0af69932-af66-4d90-9bd4-d68285cff5bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:47.745251 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0af69932-af66-4d90-9bd4-d68285cff5bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:47.751612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0af69932-af66-4d90-9bd4-d68285cff5bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:47.751941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0af69932-af66-4d90-9bd4-d68285cff5bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:47.752707 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0af69932-af66-4d90-9bd4-d68285cff5bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:47.753155 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0af69932-af66-4d90-9bd4-d68285cff5bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:47.775551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0af69932-af66-4d90-9bd4-d68285cff5bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/ips" status: 200 len: 150 microversion: 2.1 time: 0.034823 May 17 18:14:47.776612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 146/285] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 17 18:14:47 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:14:48.579828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0917f5a4-955f-4378-9200-de580d029715 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:48.580748 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0917f5a4-955f-4378-9200-de580d029715 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:48.588132 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0917f5a4-955f-4378-9200-de580d029715 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:48.588132 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0917f5a4-955f-4378-9200-de580d029715 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:48.588354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0917f5a4-955f-4378-9200-de580d029715 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:48.588831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0917f5a4-955f-4378-9200-de580d029715 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:48.717624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0917f5a4-955f-4378-9200-de580d029715 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:48.724949 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0917f5a4-955f-4378-9200-de580d029715 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.149139 May 17 18:14:48.725520 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 140/286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:48 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:14:49.741336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f6019869-f039-4d58-a52d-98286a4bbf95 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:49.742098 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f6019869-f039-4d58-a52d-98286a4bbf95 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:49.763274 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f6019869-f039-4d58-a52d-98286a4bbf95 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:49.763823 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f6019869-f039-4d58-a52d-98286a4bbf95 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:49.764634 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f6019869-f039-4d58-a52d-98286a4bbf95 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:49.765080 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f6019869-f039-4d58-a52d-98286a4bbf95 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:49.897337 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f6019869-f039-4d58-a52d-98286a4bbf95 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:49.905438 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f6019869-f039-4d58-a52d-98286a4bbf95 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.168097 May 17 18:14:49.906004 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 147/287] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:49 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:50.868535 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1a5bd2c1-c359-49bf-a269-e571028593e0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:50.869044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1a5bd2c1-c359-49bf-a269-e571028593e0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:50.875314 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1a5bd2c1-c359-49bf-a269-e571028593e0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:50.875772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1a5bd2c1-c359-49bf-a269-e571028593e0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:50.876550 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1a5bd2c1-c359-49bf-a269-e571028593e0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:50.876994 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1a5bd2c1-c359-49bf-a269-e571028593e0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:50.903093 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1a5bd2c1-c359-49bf-a269-e571028593e0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/ips" status: 200 len: 152 microversion: 2.20 time: 0.038538 May 17 18:14:50.903818 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 141/288] 10.222.0.25 () {60 vars in 1288 bytes} [Tue May 17 18:14:50 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:14:50.923854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9e85f1fb-d701-4ea3-bf70-c3b916939b76 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:50.925147 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9e85f1fb-d701-4ea3-bf70-c3b916939b76 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:50.937089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9e85f1fb-d701-4ea3-bf70-c3b916939b76 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:50.937810 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9e85f1fb-d701-4ea3-bf70-c3b916939b76 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:50.938711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9e85f1fb-d701-4ea3-bf70-c3b916939b76 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:50.939369 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9e85f1fb-d701-4ea3-bf70-c3b916939b76 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:51.103345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9e85f1fb-d701-4ea3-bf70-c3b916939b76 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:51.111661 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9e85f1fb-d701-4ea3-bf70-c3b916939b76 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.192749 May 17 18:14:51.112230 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 148/289] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:50 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:51.245917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7bbb9c76-eb6e-48ee-8ea1-38667d2e5d9b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aae50e3a-e469-462e-9d10-5b53213562e9"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:14:51.247228 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7bbb9c76-eb6e-48ee-8ea1-38667d2e5d9b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:51.253076 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7bbb9c76-eb6e-48ee-8ea1-38667d2e5d9b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:51.253591 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7bbb9c76-eb6e-48ee-8ea1-38667d2e5d9b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:51.254415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7bbb9c76-eb6e-48ee-8ea1-38667d2e5d9b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:51.254941 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7bbb9c76-eb6e-48ee-8ea1-38667d2e5d9b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:52.129035 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-dbc6aa83-b557-4afb-90b1-646f674f72b8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:52.129712 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-dbc6aa83-b557-4afb-90b1-646f674f72b8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:52.136323 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dbc6aa83-b557-4afb-90b1-646f674f72b8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:52.136770 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dbc6aa83-b557-4afb-90b1-646f674f72b8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:52.137537 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dbc6aa83-b557-4afb-90b1-646f674f72b8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:52.138044 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dbc6aa83-b557-4afb-90b1-646f674f72b8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:52.265121 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-dbc6aa83-b557-4afb-90b1-646f674f72b8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:52.272645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-dbc6aa83-b557-4afb-90b1-646f674f72b8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.147455 May 17 18:14:52.273290 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 149/290] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:52 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:14:53.289988 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8c853169-7331-46e6-b41a-5a238b151bf9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:53.290607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8c853169-7331-46e6-b41a-5a238b151bf9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:53.296869 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8c853169-7331-46e6-b41a-5a238b151bf9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:53.297318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8c853169-7331-46e6-b41a-5a238b151bf9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:53.298073 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8c853169-7331-46e6-b41a-5a238b151bf9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:53.298506 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8c853169-7331-46e6-b41a-5a238b151bf9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:53.429499 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8c853169-7331-46e6-b41a-5a238b151bf9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:53.437421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8c853169-7331-46e6-b41a-5a238b151bf9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.151258 May 17 18:14:53.437990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 150/291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:53 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:14:54.454739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6d9e2df1-058b-4c86-ba15-0ebcbe6c8696 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:54.455342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6d9e2df1-058b-4c86-ba15-0ebcbe6c8696 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:54.461459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6d9e2df1-058b-4c86-ba15-0ebcbe6c8696 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:54.461902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6d9e2df1-058b-4c86-ba15-0ebcbe6c8696 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:54.462685 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6d9e2df1-058b-4c86-ba15-0ebcbe6c8696 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:54.463121 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6d9e2df1-058b-4c86-ba15-0ebcbe6c8696 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:54.589923 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6d9e2df1-058b-4c86-ba15-0ebcbe6c8696 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:54.597131 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6d9e2df1-058b-4c86-ba15-0ebcbe6c8696 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.146321 May 17 18:14:54.597691 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 151/292] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:54 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:14:54.947019 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7bbb9c76-eb6e-48ee-8ea1-38667d2e5d9b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.705042 May 17 18:14:54.947675 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 142/293] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:14:51 2022] POST /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-volume_attachments => generated 194 bytes in 3707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:14:55.613873 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c7508256-8c5f-4fd9-a352-5eac46f9d8c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:55.614487 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c7508256-8c5f-4fd9-a352-5eac46f9d8c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:55.621260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c7508256-8c5f-4fd9-a352-5eac46f9d8c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:55.621719 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c7508256-8c5f-4fd9-a352-5eac46f9d8c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:55.622502 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c7508256-8c5f-4fd9-a352-5eac46f9d8c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:55.622975 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c7508256-8c5f-4fd9-a352-5eac46f9d8c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:55.756375 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c7508256-8c5f-4fd9-a352-5eac46f9d8c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:55.764133 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c7508256-8c5f-4fd9-a352-5eac46f9d8c2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.154186 May 17 18:14:55.764700 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 152/294] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:55 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:56.591871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9569803e-e82d-4788-b704-c3cfa0e4fac3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:14:56.592408 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9569803e-e82d-4788-b704-c3cfa0e4fac3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:56.599001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9569803e-e82d-4788-b704-c3cfa0e4fac3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:56.599459 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9569803e-e82d-4788-b704-c3cfa0e4fac3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:56.600222 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9569803e-e82d-4788-b704-c3cfa0e4fac3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:56.600658 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9569803e-e82d-4788-b704-c3cfa0e4fac3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:56.624465 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-9569803e-e82d-4788-b704-c3cfa0e4fac3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lazy-loading 'flavor' on Instance uuid 769abf30-807c-41f0-bd94-0809137c0155 {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:14:56.781507 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8f772916-4d56-4828-abb5-b10d72020779 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:56.782113 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8f772916-4d56-4828-abb5-b10d72020779 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:56.788375 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8f772916-4d56-4828-abb5-b10d72020779 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:56.788823 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8f772916-4d56-4828-abb5-b10d72020779 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:56.789579 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8f772916-4d56-4828-abb5-b10d72020779 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:56.790015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8f772916-4d56-4828-abb5-b10d72020779 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:56.925954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8f772916-4d56-4828-abb5-b10d72020779 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:56.933238 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8f772916-4d56-4828-abb5-b10d72020779 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.156144 May 17 18:14:56.933900 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 153/295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:56 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:14:56.960354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9569803e-e82d-4788-b704-c3cfa0e4fac3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "POST /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/action" status: 202 len: 0 microversion: 2.20 time: 0.372640 May 17 18:14:56.960978 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 143/296] 10.222.0.25 () {62 vars in 1318 bytes} [Tue May 17 18:14:56 2022] POST /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:14:56.969505 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1d174000-d563-4ed6-8d63-666ad7d5e1a9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:56.970111 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1d174000-d563-4ed6-8d63-666ad7d5e1a9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:56.976041 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1d174000-d563-4ed6-8d63-666ad7d5e1a9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:56.976484 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1d174000-d563-4ed6-8d63-666ad7d5e1a9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:56.977241 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1d174000-d563-4ed6-8d63-666ad7d5e1a9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:56.977675 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1d174000-d563-4ed6-8d63-666ad7d5e1a9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:57.114305 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1d174000-d563-4ed6-8d63-666ad7d5e1a9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:57.123014 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1d174000-d563-4ed6-8d63-666ad7d5e1a9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:57.124514 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1d174000-d563-4ed6-8d63-666ad7d5e1a9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:57.125672 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1d174000-d563-4ed6-8d63-666ad7d5e1a9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.159980 May 17 18:14:57.126226 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 154/297] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:14:56 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:14:57.950920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-aec9de38-06f8-48b5-89dc-7bc2965dde01 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:57.951627 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-aec9de38-06f8-48b5-89dc-7bc2965dde01 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:57.957803 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aec9de38-06f8-48b5-89dc-7bc2965dde01 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:57.958256 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aec9de38-06f8-48b5-89dc-7bc2965dde01 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:57.959050 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aec9de38-06f8-48b5-89dc-7bc2965dde01 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:57.959490 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aec9de38-06f8-48b5-89dc-7bc2965dde01 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:58.097768 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-aec9de38-06f8-48b5-89dc-7bc2965dde01 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:58.105470 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-aec9de38-06f8-48b5-89dc-7bc2965dde01 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.159838 May 17 18:14:58.106390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 144/298] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:57 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:58.143810 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f5988f96-b3cc-4290-925d-c6e8b4760b20 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:58.144513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f5988f96-b3cc-4290-925d-c6e8b4760b20 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:58.151304 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f5988f96-b3cc-4290-925d-c6e8b4760b20 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:58.152319 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f5988f96-b3cc-4290-925d-c6e8b4760b20 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:58.153100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f5988f96-b3cc-4290-925d-c6e8b4760b20 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:58.153537 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f5988f96-b3cc-4290-925d-c6e8b4760b20 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:58.285600 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f5988f96-b3cc-4290-925d-c6e8b4760b20 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:58.293753 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f5988f96-b3cc-4290-925d-c6e8b4760b20 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:58.295810 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f5988f96-b3cc-4290-925d-c6e8b4760b20 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:58.297025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f5988f96-b3cc-4290-925d-c6e8b4760b20 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.157096 May 17 18:14:58.297739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 155/299] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:14:58 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:14:59.122207 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ee72e226-9ed3-46f7-8928-dcd4fdd5302f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:59.122869 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ee72e226-9ed3-46f7-8928-dcd4fdd5302f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:59.129162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee72e226-9ed3-46f7-8928-dcd4fdd5302f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:59.129608 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee72e226-9ed3-46f7-8928-dcd4fdd5302f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:59.130359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee72e226-9ed3-46f7-8928-dcd4fdd5302f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:59.130819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee72e226-9ed3-46f7-8928-dcd4fdd5302f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:59.275226 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ee72e226-9ed3-46f7-8928-dcd4fdd5302f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:59.283216 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ee72e226-9ed3-46f7-8928-dcd4fdd5302f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.164929 May 17 18:14:59.283786 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 145/300] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:59 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:14:59.315578 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7bbe96d0-db2b-46cb-9676-ed6bda380159 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:59.316191 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7bbe96d0-db2b-46cb-9676-ed6bda380159 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:59.331130 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7bbe96d0-db2b-46cb-9676-ed6bda380159 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:59.336640 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7bbe96d0-db2b-46cb-9676-ed6bda380159 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:59.338600 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7bbe96d0-db2b-46cb-9676-ed6bda380159 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:59.339855 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7bbe96d0-db2b-46cb-9676-ed6bda380159 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:59.473487 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-54733326-6afe-4ceb-8679-e9b5c9ab5948 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:14:59.480566 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-54733326-6afe-4ceb-8679-e9b5c9ab5948 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:59.481533 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-54733326-6afe-4ceb-8679-e9b5c9ab5948 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:59.511189 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7bbe96d0-db2b-46cb-9676-ed6bda380159 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:59.522024 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7bbe96d0-db2b-46cb-9676-ed6bda380159 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:59.523665 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7bbe96d0-db2b-46cb-9676-ed6bda380159 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:59.524918 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7bbe96d0-db2b-46cb-9676-ed6bda380159 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.213409 May 17 18:14:59.525533 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 156/301] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:14:59 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:14:59.553469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-54733326-6afe-4ceb-8679-e9b5c9ab5948 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Going to try to stop instance {{(pid=117021) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 18:14:59.597563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-54733326-6afe-4ceb-8679-e9b5c9ab5948 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/action" status: 202 len: 0 microversion: 2.1 time: 0.128304 May 17 18:14:59.598188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 146/302] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:14:59 2022] POST /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:14:59.607011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-aea55728-b2a6-4e96-98df-b2b9e369778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:14:59.607621 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-aea55728-b2a6-4e96-98df-b2b9e369778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:14:59.613427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-aea55728-b2a6-4e96-98df-b2b9e369778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:59.613877 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-aea55728-b2a6-4e96-98df-b2b9e369778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:59.614685 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-aea55728-b2a6-4e96-98df-b2b9e369778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:14:59.615122 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-aea55728-b2a6-4e96-98df-b2b9e369778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:14:59.749605 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-aea55728-b2a6-4e96-98df-b2b9e369778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:14:59.757300 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-aea55728-b2a6-4e96-98df-b2b9e369778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.154835 May 17 18:14:59.757855 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 157/303] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:14:59 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:00.301206 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-db5053c4-00ec-44c8-8a42-be5d3ef1425f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:00.301938 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-db5053c4-00ec-44c8-8a42-be5d3ef1425f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:00.307874 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-db5053c4-00ec-44c8-8a42-be5d3ef1425f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:00.308477 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-db5053c4-00ec-44c8-8a42-be5d3ef1425f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:00.309193 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-db5053c4-00ec-44c8-8a42-be5d3ef1425f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:00.309624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-db5053c4-00ec-44c8-8a42-be5d3ef1425f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:00.448163 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-db5053c4-00ec-44c8-8a42-be5d3ef1425f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:00.458154 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-db5053c4-00ec-44c8-8a42-be5d3ef1425f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.161518 May 17 18:15:00.458917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 147/304] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:00 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:00.543792 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e1110255-2516-4ac4-837b-e4c8332a5faa tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:00.544435 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e1110255-2516-4ac4-837b-e4c8332a5faa tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:00.550774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e1110255-2516-4ac4-837b-e4c8332a5faa tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:00.551233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e1110255-2516-4ac4-837b-e4c8332a5faa tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:00.552010 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e1110255-2516-4ac4-837b-e4c8332a5faa tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:00.552454 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e1110255-2516-4ac4-837b-e4c8332a5faa tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:00.687876 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e1110255-2516-4ac4-837b-e4c8332a5faa tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:00.696435 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e1110255-2516-4ac4-837b-e4c8332a5faa tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:00.697960 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e1110255-2516-4ac4-837b-e4c8332a5faa tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:00.699783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e1110255-2516-4ac4-837b-e4c8332a5faa tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.160647 May 17 18:15:00.700338 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 158/305] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:00 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:00.775717 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a99a7853-ee6e-4910-b381-4e1436ed3647 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:00.776839 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a99a7853-ee6e-4910-b381-4e1436ed3647 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:00.783025 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a99a7853-ee6e-4910-b381-4e1436ed3647 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:00.783529 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a99a7853-ee6e-4910-b381-4e1436ed3647 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:00.784299 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a99a7853-ee6e-4910-b381-4e1436ed3647 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:00.784736 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a99a7853-ee6e-4910-b381-4e1436ed3647 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:00.923866 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a99a7853-ee6e-4910-b381-4e1436ed3647 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:00.934805 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a99a7853-ee6e-4910-b381-4e1436ed3647 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.164604 May 17 18:15:00.935399 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 148/306] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:00 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:01.490440 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-23c93adc-383f-4a9a-9ca4-93f4ca4d12e0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:01.491483 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-23c93adc-383f-4a9a-9ca4-93f4ca4d12e0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:01.503995 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-23c93adc-383f-4a9a-9ca4-93f4ca4d12e0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:01.504533 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-23c93adc-383f-4a9a-9ca4-93f4ca4d12e0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:01.505538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-23c93adc-383f-4a9a-9ca4-93f4ca4d12e0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:01.506218 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-23c93adc-383f-4a9a-9ca4-93f4ca4d12e0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:01.640784 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-23c93adc-383f-4a9a-9ca4-93f4ca4d12e0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:01.647988 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-23c93adc-383f-4a9a-9ca4-93f4ca4d12e0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.161354 May 17 18:15:01.648766 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 159/307] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:01 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:01.717974 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5bfdb421-df0a-4321-bd27-8111664864ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:01.718727 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5bfdb421-df0a-4321-bd27-8111664864ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:01.726027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5bfdb421-df0a-4321-bd27-8111664864ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:01.726447 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5bfdb421-df0a-4321-bd27-8111664864ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:01.727256 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5bfdb421-df0a-4321-bd27-8111664864ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:01.727706 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5bfdb421-df0a-4321-bd27-8111664864ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:01.860259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5bfdb421-df0a-4321-bd27-8111664864ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:01.867831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5bfdb421-df0a-4321-bd27-8111664864ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:01.869326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5bfdb421-df0a-4321-bd27-8111664864ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:01.870466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5bfdb421-df0a-4321-bd27-8111664864ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.156900 May 17 18:15:01.871048 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 149/308] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:01 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:01.952747 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9ffd5c46-4c51-46f9-9e8e-0af4d51cfc34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:01.953359 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9ffd5c46-4c51-46f9-9e8e-0af4d51cfc34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:01.959636 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ffd5c46-4c51-46f9-9e8e-0af4d51cfc34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:01.960394 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ffd5c46-4c51-46f9-9e8e-0af4d51cfc34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:01.961173 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ffd5c46-4c51-46f9-9e8e-0af4d51cfc34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:01.961706 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ffd5c46-4c51-46f9-9e8e-0af4d51cfc34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:02.098444 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9ffd5c46-4c51-46f9-9e8e-0af4d51cfc34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:02.107749 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9ffd5c46-4c51-46f9-9e8e-0af4d51cfc34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.158852 May 17 18:15:02.108813 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 160/309] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:01 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:02.665158 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e3df492a-f744-4204-b5bb-e2e94f2ce1ef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:02.665857 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e3df492a-f744-4204-b5bb-e2e94f2ce1ef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:02.674342 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e3df492a-f744-4204-b5bb-e2e94f2ce1ef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:02.675368 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e3df492a-f744-4204-b5bb-e2e94f2ce1ef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:02.678161 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e3df492a-f744-4204-b5bb-e2e94f2ce1ef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:02.680072 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e3df492a-f744-4204-b5bb-e2e94f2ce1ef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:02.832660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e3df492a-f744-4204-b5bb-e2e94f2ce1ef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:02.841942 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e3df492a-f744-4204-b5bb-e2e94f2ce1ef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.180533 May 17 18:15:02.843212 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 150/310] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:02 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:02.889049 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-56689590-2c79-4d71-8875-e25bf26e6ac8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:02.889743 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-56689590-2c79-4d71-8875-e25bf26e6ac8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:02.896568 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56689590-2c79-4d71-8875-e25bf26e6ac8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:02.897024 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56689590-2c79-4d71-8875-e25bf26e6ac8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:02.897800 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56689590-2c79-4d71-8875-e25bf26e6ac8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:02.898237 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56689590-2c79-4d71-8875-e25bf26e6ac8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:03.050440 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-56689590-2c79-4d71-8875-e25bf26e6ac8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:03.058969 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-56689590-2c79-4d71-8875-e25bf26e6ac8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:03.060497 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-56689590-2c79-4d71-8875-e25bf26e6ac8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:03.061667 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-56689590-2c79-4d71-8875-e25bf26e6ac8 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.177135 May 17 18:15:03.062224 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 161/311] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:02 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:03.124739 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-17150c79-23f6-42ef-928f-16242b1da244 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:03.125362 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-17150c79-23f6-42ef-928f-16242b1da244 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:03.131193 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17150c79-23f6-42ef-928f-16242b1da244 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:03.131632 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17150c79-23f6-42ef-928f-16242b1da244 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:03.132505 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17150c79-23f6-42ef-928f-16242b1da244 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:03.132953 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17150c79-23f6-42ef-928f-16242b1da244 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:03.267524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-17150c79-23f6-42ef-928f-16242b1da244 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:03.275531 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-17150c79-23f6-42ef-928f-16242b1da244 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.154683 May 17 18:15:03.276093 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 151/312] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:03 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:03.762802 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2ad91c3b-95ee-4e70-80e0-3114444e3688 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:03.763413 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2ad91c3b-95ee-4e70-80e0-3114444e3688 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:03.769994 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2ad91c3b-95ee-4e70-80e0-3114444e3688 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:03.770452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2ad91c3b-95ee-4e70-80e0-3114444e3688 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:03.771296 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2ad91c3b-95ee-4e70-80e0-3114444e3688 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:03.771767 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2ad91c3b-95ee-4e70-80e0-3114444e3688 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:03.863186 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1d1929c6-5342-4e20-92e5-9a1486427ac3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:03.864553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1d1929c6-5342-4e20-92e5-9a1486427ac3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:03.872873 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d1929c6-5342-4e20-92e5-9a1486427ac3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:03.873339 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d1929c6-5342-4e20-92e5-9a1486427ac3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:03.874762 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d1929c6-5342-4e20-92e5-9a1486427ac3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:03.875237 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d1929c6-5342-4e20-92e5-9a1486427ac3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:03.920453 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-2ad91c3b-95ee-4e70-80e0-3114444e3688 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lazy-loading 'services' on Instance uuid bd7755ca-b31f-4866-bbad-d9265b908ede {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:15:04.085397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2ad91c3b-95ee-4e70-80e0-3114444e3688 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede/os-volume_attachments/29667064-9bd2-4c14-917f-3fee87871b40" status: 202 len: 0 microversion: 2.1 time: 0.326825 May 17 18:15:04.086689 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 162/313] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:15:03 2022] DELETE /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede/os-volume_attachments/29667064-9bd2-4c14-917f-3fee87871b40 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:15:04.096918 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1d1929c6-5342-4e20-92e5-9a1486427ac3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:04.097546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-53e4b2e6-2ac7-4eab-a8a4-9d4d31ab9531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:04.099039 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-53e4b2e6-2ac7-4eab-a8a4-9d4d31ab9531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:04.108115 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-53e4b2e6-2ac7-4eab-a8a4-9d4d31ab9531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:04.108841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-53e4b2e6-2ac7-4eab-a8a4-9d4d31ab9531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:04.109802 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-53e4b2e6-2ac7-4eab-a8a4-9d4d31ab9531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:04.110558 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-53e4b2e6-2ac7-4eab-a8a4-9d4d31ab9531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:04.120369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1d1929c6-5342-4e20-92e5-9a1486427ac3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1502 microversion: 2.1 time: 0.264797 May 17 18:15:04.147217 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 152/314] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:03 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1502 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:04.161035 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0e72fba2-c9b0-4ae9-b89b-cf6243aa8983 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d644e3d-f03d-47e7-940a-dc76ee869190"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:04.162281 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0e72fba2-c9b0-4ae9-b89b-cf6243aa8983 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:04.169597 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e72fba2-c9b0-4ae9-b89b-cf6243aa8983 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:04.170079 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e72fba2-c9b0-4ae9-b89b-cf6243aa8983 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:04.170901 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e72fba2-c9b0-4ae9-b89b-cf6243aa8983 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:04.171337 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e72fba2-c9b0-4ae9-b89b-cf6243aa8983 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:04.204931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-0e72fba2-c9b0-4ae9-b89b-cf6243aa8983 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] HTTP exception thrown: Cannot 'attach_volume' instance 530a3eb3-cd60-4f22-a693-6221a19eea5f while it is in vm_state rescued May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0e72fba2-c9b0-4ae9-b89b-cf6243aa8983 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Request method failure captured: May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: POST /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f/os-volume_attachments HTTP/1.1 May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 74 May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WzWKI_qp77YHLeymkbA2nMR_qjOtmmqk6FaK9Yh75xjb8QQi3BjnX6MQP8riZ5sjsky4n7JVdRB8b1lc7H08V0xUoslnGDT-ip1glIuAAu0KM-xhJdoQgc3lKpgHfXh5chSWnW0mA98TTJaSlVnRvKoUQkzDfbsJt1EL74HYlh9BI May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: e32e7b68f0464827afc5ed835cee1d15 May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:15:04.207352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e32e7b68f0464827afc5ed835cee1d15", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: e32e7b68f0464827afc5ed835cee1d15 May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-ServerRescueNegativeTestJSON-1083069676-project May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 62a9f27a865b468989f672a05dbab350 May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1083069676-project May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {"volumeAttachment": {"volumeId": "8d644e3d-f03d-47e7-940a-dc76ee869190"}} May 17 18:15:04.208778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Cannot 'attach_volume' instance 530a3eb3-cd60-4f22-a693-6221a19eea5f while it is in vm_state rescued May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'server_id': '530a3eb3-cd60-4f22-a693-6221a19eea5f', 'body': {'volumeAttachment': {'volumeId': '8d644e3d-f03d-47e7-940a-dc76ee869190'}}} May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 530a3eb3-cd60-4f22-a693-6221a19eea5f in vm_state rescued. Cannot attach_volume while the instance is in this state. May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:15:04.209648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 530a3eb3-cd60-4f22-a693-6221a19eea5f while it is in vm_state rescued May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:15:04.211528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:15:04.212602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:15:04.212602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:15:04.212602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 530a3eb3-cd60-4f22-a693-6221a19eea5f while it is in vm_state rescued May 17 18:15:04.212602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:15:04.212602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0e72fba2-c9b0-4ae9-b89b-cf6243aa8983 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Returning 409 to user: Cannot 'attach_volume' instance 530a3eb3-cd60-4f22-a693-6221a19eea5f while it is in vm_state rescued {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:15:04.212602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0e72fba2-c9b0-4ae9-b89b-cf6243aa8983 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054923 May 17 18:15:04.213197 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 153/315] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:15:04 2022] POST /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 17 18:15:04.225094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fad16afc-f810-4a74-b586-228005eb034d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:04.225823 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-fad16afc-f810-4a74-b586-228005eb034d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:04.232381 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fad16afc-f810-4a74-b586-228005eb034d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:04.233073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fad16afc-f810-4a74-b586-228005eb034d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:04.234010 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fad16afc-f810-4a74-b586-228005eb034d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:04.234800 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fad16afc-f810-4a74-b586-228005eb034d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:04.344107 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-53e4b2e6-2ac7-4eab-a8a4-9d4d31ab9531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:04.356679 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-fad16afc-f810-4a74-b586-228005eb034d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f/action" status: 202 len: 0 microversion: 2.1 time: 0.141671 May 17 18:15:04.357725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 154/316] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:15:04 2022] POST /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:15:04.359041 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-53e4b2e6-2ac7-4eab-a8a4-9d4d31ab9531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:04.360955 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-53e4b2e6-2ac7-4eab-a8a4-9d4d31ab9531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:04.362147 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-53e4b2e6-2ac7-4eab-a8a4-9d4d31ab9531 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.273873 May 17 18:15:04.362744 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 163/317] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:04 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:04.376212 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3333336f-06d0-47af-8011-14ec10551c6d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:04.377067 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3333336f-06d0-47af-8011-14ec10551c6d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:04.384751 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3333336f-06d0-47af-8011-14ec10551c6d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:04.385424 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3333336f-06d0-47af-8011-14ec10551c6d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:04.387390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3333336f-06d0-47af-8011-14ec10551c6d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:04.388096 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3333336f-06d0-47af-8011-14ec10551c6d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:04.389214 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ba5163f7-e1bf-4076-badb-6f9a7f1ef134 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:04.390288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ba5163f7-e1bf-4076-badb-6f9a7f1ef134 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:04.404093 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ba5163f7-e1bf-4076-badb-6f9a7f1ef134 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:04.405029 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ba5163f7-e1bf-4076-badb-6f9a7f1ef134 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:04.407183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ba5163f7-e1bf-4076-badb-6f9a7f1ef134 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:04.408577 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ba5163f7-e1bf-4076-badb-6f9a7f1ef134 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:04.665577 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ba5163f7-e1bf-4076-badb-6f9a7f1ef134 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:04.668493 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3333336f-06d0-47af-8011-14ec10551c6d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:04.679496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3333336f-06d0-47af-8011-14ec10551c6d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.320151 May 17 18:15:04.679826 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ba5163f7-e1bf-4076-badb-6f9a7f1ef134 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1510 microversion: 2.1 time: 0.298061 May 17 18:15:04.680482 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 155/318] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:04 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:04.681487 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 164/319] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:04 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:05.380842 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-678f8328-6b67-4c91-9c3a-4d5949434f6f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:05.381485 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-678f8328-6b67-4c91-9c3a-4d5949434f6f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:05.388774 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-678f8328-6b67-4c91-9c3a-4d5949434f6f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:05.389255 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-678f8328-6b67-4c91-9c3a-4d5949434f6f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:05.390035 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-678f8328-6b67-4c91-9c3a-4d5949434f6f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:05.390476 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-678f8328-6b67-4c91-9c3a-4d5949434f6f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:05.583551 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-678f8328-6b67-4c91-9c3a-4d5949434f6f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:05.593737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-678f8328-6b67-4c91-9c3a-4d5949434f6f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:05.602062 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-678f8328-6b67-4c91-9c3a-4d5949434f6f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:05.603712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-678f8328-6b67-4c91-9c3a-4d5949434f6f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.226648 May 17 18:15:05.605658 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 156/320] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:05 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:05.698420 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b848f0e6-4d8a-4c6f-8117-5a5645a735a0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:05.699048 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b848f0e6-4d8a-4c6f-8117-5a5645a735a0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:05.705417 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ed567005-72ad-480a-9c5f-34b85b8aea81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:05.705971 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ed567005-72ad-480a-9c5f-34b85b8aea81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:05.712239 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b848f0e6-4d8a-4c6f-8117-5a5645a735a0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:05.712696 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b848f0e6-4d8a-4c6f-8117-5a5645a735a0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:05.712809 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ed567005-72ad-480a-9c5f-34b85b8aea81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:05.713190 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ed567005-72ad-480a-9c5f-34b85b8aea81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:05.713466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b848f0e6-4d8a-4c6f-8117-5a5645a735a0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:05.714433 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b848f0e6-4d8a-4c6f-8117-5a5645a735a0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:05.714592 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ed567005-72ad-480a-9c5f-34b85b8aea81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:05.715211 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ed567005-72ad-480a-9c5f-34b85b8aea81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:05.925282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ed567005-72ad-480a-9c5f-34b85b8aea81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:05.932672 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b848f0e6-4d8a-4c6f-8117-5a5645a735a0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:05.934096 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ed567005-72ad-480a-9c5f-34b85b8aea81 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.240675 May 17 18:15:05.934697 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 165/321] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:05 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:05.941253 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b848f0e6-4d8a-4c6f-8117-5a5645a735a0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1510 microversion: 2.1 time: 0.246593 May 17 18:15:05.941926 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 157/322] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:05 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:06.622963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f07550ee-e517-4591-9e7a-c3c38a124573 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:06.623926 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f07550ee-e517-4591-9e7a-c3c38a124573 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:06.632585 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f07550ee-e517-4591-9e7a-c3c38a124573 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:06.651184 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f07550ee-e517-4591-9e7a-c3c38a124573 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:06.653829 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f07550ee-e517-4591-9e7a-c3c38a124573 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:06.654449 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f07550ee-e517-4591-9e7a-c3c38a124573 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:06.815575 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-cb21d063-3f14-4bd3-9212-7b32d29261e7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: .version_select at 0x7f74ab660ca0>, body: {"keypair": {"name": "tempest-keypair-331636660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF8NogJbupX0HfILYDySVLbO0bLccykMcaSpxLKLmm9ZpaSj0xdJg725wNr7Us9E/25ZePIa1UJy6DsFZ98T92nddt/2tPo/2MBnuIiUU/uwvU4K3llOlfGCC9ZJ70Tbw=="}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:06.836472 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-cb21d063-3f14-4bd3-9212-7b32d29261e7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:15:06.841552 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-cb21d063-3f14-4bd3-9212-7b32d29261e7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for user c7b641ce301a4b7685f0f70d7ac4a5d3 and project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:15:06.874069 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-cb21d063-3f14-4bd3-9212-7b32d29261e7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062309 May 17 18:15:06.875047 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 158/323] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 17 18:15:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:06.955996 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-80efe208-cfaf-4236-8fd9-1c17ee488540 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:06.957553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-80efe208-cfaf-4236-8fd9-1c17ee488540 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:06.965661 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-80efe208-cfaf-4236-8fd9-1c17ee488540 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:06.966916 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-80efe208-cfaf-4236-8fd9-1c17ee488540 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:06.967912 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-80efe208-cfaf-4236-8fd9-1c17ee488540 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:06.969097 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-80efe208-cfaf-4236-8fd9-1c17ee488540 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:07.114679 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f07550ee-e517-4591-9e7a-c3c38a124573 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:07.133174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f07550ee-e517-4591-9e7a-c3c38a124573 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:07.137148 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f07550ee-e517-4591-9e7a-c3c38a124573 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:07.138625 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f07550ee-e517-4591-9e7a-c3c38a124573 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.520067 May 17 18:15:07.150191 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 166/324] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:06 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:07.157709 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-26b73461-126a-4b28-9b17-2f1d277c967f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:07.158981 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-26b73461-126a-4b28-9b17-2f1d277c967f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:07.169530 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-26b73461-126a-4b28-9b17-2f1d277c967f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:07.170123 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-26b73461-126a-4b28-9b17-2f1d277c967f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:07.171170 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-26b73461-126a-4b28-9b17-2f1d277c967f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:07.171762 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-26b73461-126a-4b28-9b17-2f1d277c967f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:07.219475 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-80efe208-cfaf-4236-8fd9-1c17ee488540 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:07.227373 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-80efe208-cfaf-4236-8fd9-1c17ee488540 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.279155 May 17 18:15:07.227952 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 159/325] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:06 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:07.381385 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d5e6b621-072c-44cc-9a31-2cf7b1d0e68f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:07.382070 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d5e6b621-072c-44cc-9a31-2cf7b1d0e68f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:07.389120 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d5e6b621-072c-44cc-9a31-2cf7b1d0e68f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:07.389892 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d5e6b621-072c-44cc-9a31-2cf7b1d0e68f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:07.390928 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d5e6b621-072c-44cc-9a31-2cf7b1d0e68f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:07.391586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d5e6b621-072c-44cc-9a31-2cf7b1d0e68f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:07.447250 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d5e6b621-072c-44cc-9a31-2cf7b1d0e68f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:15:07.447428 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-26b73461-126a-4b28-9b17-2f1d277c967f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:07.458769 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-26b73461-126a-4b28-9b17-2f1d277c967f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1510 microversion: 2.1 time: 0.307099 May 17 18:15:07.462163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 167/326] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:07 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:07.609716 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d5e6b621-072c-44cc-9a31-2cf7b1d0e68f tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 204 len: 0 microversion: 2.1 time: 0.231075 May 17 18:15:07.616342 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 160/327] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:15:07 2022] DELETE /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:15:07.625678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8ec8820d-3bfc-4d09-af08-1b847fd3ef1b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:07.626615 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8ec8820d-3bfc-4d09-af08-1b847fd3ef1b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:07.634154 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8ec8820d-3bfc-4d09-af08-1b847fd3ef1b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:07.635239 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8ec8820d-3bfc-4d09-af08-1b847fd3ef1b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:07.638110 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8ec8820d-3bfc-4d09-af08-1b847fd3ef1b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:07.638880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8ec8820d-3bfc-4d09-af08-1b847fd3ef1b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:07.856404 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8ec8820d-3bfc-4d09-af08-1b847fd3ef1b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:07.873516 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8ec8820d-3bfc-4d09-af08-1b847fd3ef1b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1559 microversion: 2.1 time: 0.255271 May 17 18:15:07.875069 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 168/328] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:07 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1559 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:08.162548 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ef14b9ff-f227-4b0b-b594-2768eba01d00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:08.163286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ef14b9ff-f227-4b0b-b594-2768eba01d00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:08.170787 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef14b9ff-f227-4b0b-b594-2768eba01d00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:08.171510 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef14b9ff-f227-4b0b-b594-2768eba01d00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:08.173790 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef14b9ff-f227-4b0b-b594-2768eba01d00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:08.174397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef14b9ff-f227-4b0b-b594-2768eba01d00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:08.246962 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-751200ba-1fa0-4c0e-8b21-0eae6b4ea809 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:08.248239 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-751200ba-1fa0-4c0e-8b21-0eae6b4ea809 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:08.255444 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-751200ba-1fa0-4c0e-8b21-0eae6b4ea809 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:08.258455 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-751200ba-1fa0-4c0e-8b21-0eae6b4ea809 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:08.259490 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-751200ba-1fa0-4c0e-8b21-0eae6b4ea809 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:08.260085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-751200ba-1fa0-4c0e-8b21-0eae6b4ea809 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:08.496018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ef14b9ff-f227-4b0b-b594-2768eba01d00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:08.507462 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ef14b9ff-f227-4b0b-b594-2768eba01d00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:08.508991 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ef14b9ff-f227-4b0b-b594-2768eba01d00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:08.514348 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ef14b9ff-f227-4b0b-b594-2768eba01d00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.356725 May 17 18:15:08.516691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 161/329] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:08 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:08.523985 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6ebfa726-8c58-4024-9ab5-280c76846f4d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:08.530263 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6ebfa726-8c58-4024-9ab5-280c76846f4d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:08.536694 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ebfa726-8c58-4024-9ab5-280c76846f4d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:08.537138 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ebfa726-8c58-4024-9ab5-280c76846f4d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:08.537920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ebfa726-8c58-4024-9ab5-280c76846f4d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:08.538347 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ebfa726-8c58-4024-9ab5-280c76846f4d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:08.574267 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-751200ba-1fa0-4c0e-8b21-0eae6b4ea809 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:08.588134 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-751200ba-1fa0-4c0e-8b21-0eae6b4ea809 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.344953 May 17 18:15:08.593710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 169/330] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:08 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:08.674441 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2006949035", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc022e51-2bed-4b09-b828-c8708bb8de4d"}], "security_groups": [{"name": "tempest-securitygroup--1850102558"}], "key_name": "tempest-keypair-331636660", "user_data": "}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:08.867750 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] validate_networks() for [('bc022e51-2bed-4b09-b828-c8708bb8de4d', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:15:08.903477 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6ebfa726-8c58-4024-9ab5-280c76846f4d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:08.911595 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6ebfa726-8c58-4024-9ab5-280c76846f4d tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1510 microversion: 2.1 time: 0.391225 May 17 18:15:08.912208 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 162/331] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:08 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:08.918339 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-17943098-5a6d-47e7-bdcb-727b32678b42 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:08.919179 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-17943098-5a6d-47e7-bdcb-727b32678b42 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:08.925512 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17943098-5a6d-47e7-bdcb-727b32678b42 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:08.926206 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17943098-5a6d-47e7-bdcb-727b32678b42 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:08.927165 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17943098-5a6d-47e7-bdcb-727b32678b42 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:08.927743 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17943098-5a6d-47e7-bdcb-727b32678b42 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:09.475126 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-17943098-5a6d-47e7-bdcb-727b32678b42 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:09.483648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-17943098-5a6d-47e7-bdcb-727b32678b42 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.570209 May 17 18:15:09.484854 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 163/332] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:08 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:09.549159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7cdf53ad-368d-4671-b56b-2eac0110ebb0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:09.555529 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7cdf53ad-368d-4671-b56b-2eac0110ebb0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:09.565750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7cdf53ad-368d-4671-b56b-2eac0110ebb0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:09.566704 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7cdf53ad-368d-4671-b56b-2eac0110ebb0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:09.568675 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7cdf53ad-368d-4671-b56b-2eac0110ebb0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:09.569356 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7cdf53ad-368d-4671-b56b-2eac0110ebb0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:09.848045 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7cdf53ad-368d-4671-b56b-2eac0110ebb0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:09.856567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7cdf53ad-368d-4671-b56b-2eac0110ebb0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:09.858071 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7cdf53ad-368d-4671-b56b-2eac0110ebb0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:09.859258 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7cdf53ad-368d-4671-b56b-2eac0110ebb0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.315994 May 17 18:15:09.860361 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 164/333] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:09 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:15:09.865014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-aa469222-c176-4350-8192-5b446e55ca9a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:09.865619 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-aa469222-c176-4350-8192-5b446e55ca9a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:09.873205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:15:09.873701 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:15:09.874080 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:15:09.874353 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa469222-c176-4350-8192-5b446e55ca9a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:09.874482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:15:09.874989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:15:09.875279 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa469222-c176-4350-8192-5b446e55ca9a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:09.876105 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa469222-c176-4350-8192-5b446e55ca9a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:09.876547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa469222-c176-4350-8192-5b446e55ca9a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:09.885113 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:09.885558 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:09.887066 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:09.887503 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:09.907332 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:15:09.914139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for user c7b641ce301a4b7685f0f70d7ac4a5d3 and project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:15:09.928785 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:15:09.931111 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:15:10.004221 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-57a5b735-7c85-4227-b746-046f76742f8d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.335725 May 17 18:15:10.005052 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 170/334] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:15:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:15:10.009689 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fa6b3a32-92e8-4ce4-a874-ae99106e2ebb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:10.011203 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fa6b3a32-92e8-4ce4-a874-ae99106e2ebb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:10.018812 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fa6b3a32-92e8-4ce4-a874-ae99106e2ebb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:10.019487 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fa6b3a32-92e8-4ce4-a874-ae99106e2ebb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:10.020484 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fa6b3a32-92e8-4ce4-a874-ae99106e2ebb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:10.021082 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fa6b3a32-92e8-4ce4-a874-ae99106e2ebb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:10.106734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-aa469222-c176-4350-8192-5b446e55ca9a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:10.114509 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-aa469222-c176-4350-8192-5b446e55ca9a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.252990 May 17 18:15:10.117860 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 165/335] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:09 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:10.126413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9d196ebf-b1e4-4cd3-a3d5-52aabcd15590 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:10.128183 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9d196ebf-b1e4-4cd3-a3d5-52aabcd15590 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:10.272370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9d196ebf-b1e4-4cd3-a3d5-52aabcd15590 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:10.284906 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9d196ebf-b1e4-4cd3-a3d5-52aabcd15590 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1241 microversion: 2.1 time: 0.163174 May 17 18:15:10.299793 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 166/336] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:10 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1241 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:10.322862 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-fa6b3a32-92e8-4ce4-a874-ae99106e2ebb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:10.332221 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fa6b3a32-92e8-4ce4-a874-ae99106e2ebb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1510 microversion: 2.1 time: 0.325992 May 17 18:15:10.333796 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 171/337] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:10 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1510 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:10.501173 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a21d6909-1002-4dc2-80e3-6c9da560e8cf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:10.501841 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a21d6909-1002-4dc2-80e3-6c9da560e8cf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:10.511880 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a21d6909-1002-4dc2-80e3-6c9da560e8cf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:10.512415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a21d6909-1002-4dc2-80e3-6c9da560e8cf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:10.513493 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a21d6909-1002-4dc2-80e3-6c9da560e8cf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:10.514000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a21d6909-1002-4dc2-80e3-6c9da560e8cf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:10.707487 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a21d6909-1002-4dc2-80e3-6c9da560e8cf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:10.715961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a21d6909-1002-4dc2-80e3-6c9da560e8cf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.218556 May 17 18:15:10.717041 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 167/338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:10 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:10.883605 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c084f9bf-dc86-44fe-9833-30c3495ea704 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:10.884610 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c084f9bf-dc86-44fe-9833-30c3495ea704 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:10.891975 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c084f9bf-dc86-44fe-9833-30c3495ea704 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:10.892896 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c084f9bf-dc86-44fe-9833-30c3495ea704 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:10.893834 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c084f9bf-dc86-44fe-9833-30c3495ea704 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:10.894423 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c084f9bf-dc86-44fe-9833-30c3495ea704 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:11.136081 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d61d9934-f052-4dd0-93ba-1dcab7c2e047 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:11.136951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d61d9934-f052-4dd0-93ba-1dcab7c2e047 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:11.144847 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d61d9934-f052-4dd0-93ba-1dcab7c2e047 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:11.145965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d61d9934-f052-4dd0-93ba-1dcab7c2e047 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:11.146994 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d61d9934-f052-4dd0-93ba-1dcab7c2e047 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:11.147469 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c084f9bf-dc86-44fe-9833-30c3495ea704 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:11.147801 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d61d9934-f052-4dd0-93ba-1dcab7c2e047 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:11.158210 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c084f9bf-dc86-44fe-9833-30c3495ea704 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:11.159743 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c084f9bf-dc86-44fe-9833-30c3495ea704 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:11.160919 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c084f9bf-dc86-44fe-9833-30c3495ea704 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.287018 May 17 18:15:11.161483 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 172/339] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:10 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:11.310306 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-05f19ab4-5952-4031-9471-0715b627ee72 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:11.311278 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-05f19ab4-5952-4031-9471-0715b627ee72 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:11.342871 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05f19ab4-5952-4031-9471-0715b627ee72 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:11.347740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05f19ab4-5952-4031-9471-0715b627ee72 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:11.348702 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05f19ab4-5952-4031-9471-0715b627ee72 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:11.349157 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05f19ab4-5952-4031-9471-0715b627ee72 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:11.475748 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d61d9934-f052-4dd0-93ba-1dcab7c2e047 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:11.480024 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-05f19ab4-5952-4031-9471-0715b627ee72 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:11.492722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-05f19ab4-5952-4031-9471-0715b627ee72 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.192163 May 17 18:15:11.493640 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d61d9934-f052-4dd0-93ba-1dcab7c2e047 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.362532 May 17 18:15:11.494945 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 168/340] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:11 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:11.496476 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 173/341] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:11 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:11.506513 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-44b9aff8-f3e5-4c03-9adf-d89ea3236aa8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:11.507165 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-44b9aff8-f3e5-4c03-9adf-d89ea3236aa8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:11.532458 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-44b9aff8-f3e5-4c03-9adf-d89ea3236aa8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:11.533339 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-44b9aff8-f3e5-4c03-9adf-d89ea3236aa8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:11.534385 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-44b9aff8-f3e5-4c03-9adf-d89ea3236aa8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:11.534836 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-44b9aff8-f3e5-4c03-9adf-d89ea3236aa8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:11.733713 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-44bb34b6-a572-490a-90db-d8269214d62d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:11.734360 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-44bb34b6-a572-490a-90db-d8269214d62d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:11.748518 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-44bb34b6-a572-490a-90db-d8269214d62d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:11.749130 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-44bb34b6-a572-490a-90db-d8269214d62d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:11.750090 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-44bb34b6-a572-490a-90db-d8269214d62d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:11.750848 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-44bb34b6-a572-490a-90db-d8269214d62d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:11.825433 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-44b9aff8-f3e5-4c03-9adf-d89ea3236aa8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:11.832867 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-44b9aff8-f3e5-4c03-9adf-d89ea3236aa8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1516 microversion: 2.1 time: 0.333057 May 17 18:15:11.833412 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 169/342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:11 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1516 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:12.053939 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-44bb34b6-a572-490a-90db-d8269214d62d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:12.064145 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-44bb34b6-a572-490a-90db-d8269214d62d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.333444 May 17 18:15:12.065644 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 174/343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:11 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:12.192306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c9876250-6621-4b5b-b9fc-304ba6b09676 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:12.193616 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c9876250-6621-4b5b-b9fc-304ba6b09676 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:12.206844 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c9876250-6621-4b5b-b9fc-304ba6b09676 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:12.207307 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c9876250-6621-4b5b-b9fc-304ba6b09676 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:12.208095 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c9876250-6621-4b5b-b9fc-304ba6b09676 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:12.215374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c9876250-6621-4b5b-b9fc-304ba6b09676 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:12.477974 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c9876250-6621-4b5b-b9fc-304ba6b09676 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:12.487761 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c9876250-6621-4b5b-b9fc-304ba6b09676 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:12.489542 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c9876250-6621-4b5b-b9fc-304ba6b09676 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:12.490965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c9876250-6621-4b5b-b9fc-304ba6b09676 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.305070 May 17 18:15:12.491690 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 170/344] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:12 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:12.513127 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d8d184e1-2200-4ba2-8a9a-766af1f86e25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:12.513423 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-82ff42be-7e5a-4965-a1db-0f7498e0a327 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:12.514162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-82ff42be-7e5a-4965-a1db-0f7498e0a327 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:12.515799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d8d184e1-2200-4ba2-8a9a-766af1f86e25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:12.520524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82ff42be-7e5a-4965-a1db-0f7498e0a327 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:12.521440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82ff42be-7e5a-4965-a1db-0f7498e0a327 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:12.522621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82ff42be-7e5a-4965-a1db-0f7498e0a327 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:12.523661 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82ff42be-7e5a-4965-a1db-0f7498e0a327 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:12.529848 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d8d184e1-2200-4ba2-8a9a-766af1f86e25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:12.530419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d8d184e1-2200-4ba2-8a9a-766af1f86e25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:12.531346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d8d184e1-2200-4ba2-8a9a-766af1f86e25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:12.532031 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d8d184e1-2200-4ba2-8a9a-766af1f86e25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:12.653866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d8d184e1-2200-4ba2-8a9a-766af1f86e25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:12.664990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d8d184e1-2200-4ba2-8a9a-766af1f86e25 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.157277 May 17 18:15:12.666183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 175/345] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:12 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:12.770018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-82ff42be-7e5a-4965-a1db-0f7498e0a327 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:12.779680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-82ff42be-7e5a-4965-a1db-0f7498e0a327 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.271975 May 17 18:15:12.780923 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 171/346] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:12 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:13.085538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-67dc31cc-596c-4ea0-b54b-37454232e7f0 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:13.087564 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-67dc31cc-596c-4ea0-b54b-37454232e7f0 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:13.099411 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67dc31cc-596c-4ea0-b54b-37454232e7f0 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:13.100159 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67dc31cc-596c-4ea0-b54b-37454232e7f0 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:13.101154 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67dc31cc-596c-4ea0-b54b-37454232e7f0 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:13.101806 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67dc31cc-596c-4ea0-b54b-37454232e7f0 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:13.362905 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3b806f8a-05fd-493d-919a-eadb52069ccf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'create', calling method: .version_select at 0x7f74ab61b940>, body: {"keypair": {"name": "tempest-keypair-1035026411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtTlcxc5B4bMfISbi5ZwKji5ec6QFTh39Fau+Tr+jmhps4dA34vpoNzpH+q/sodtn+5VTmnhTcsL1h/XcJB0xbyKx+OHxUo4ojBwex8LGvXaiO9XmS0FoUgWkxh0kprgg=="}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:13.378760 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-3b806f8a-05fd-493d-919a-eadb52069ccf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Getting quotas for project e32e7b68f0464827afc5ed835cee1d15. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:15:13.383152 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-3b806f8a-05fd-493d-919a-eadb52069ccf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Getting quotas for user 62a9f27a865b468989f672a05dbab350 and project e32e7b68f0464827afc5ed835cee1d15. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:15:13.391313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-67dc31cc-596c-4ea0-b54b-37454232e7f0 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:13.399487 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-67dc31cc-596c-4ea0-b54b-37454232e7f0 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.320280 May 17 18:15:13.410854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 176/347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:13 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:13.422944 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3b806f8a-05fd-493d-919a-eadb52069ccf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063694 May 17 18:15:13.424444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 172/348] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 17 18:15:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:13.509413 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9e08a42e-58ef-483a-bde2-05b689f7d126 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:13.510349 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9e08a42e-58ef-483a-bde2-05b689f7d126 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:13.521433 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9e08a42e-58ef-483a-bde2-05b689f7d126 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:13.521829 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9e08a42e-58ef-483a-bde2-05b689f7d126 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:13.522657 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9e08a42e-58ef-483a-bde2-05b689f7d126 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:13.523278 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9e08a42e-58ef-483a-bde2-05b689f7d126 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:13.685156 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-2f33231f-42d0-4de9-83af-3811a4f39795 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:13.686985 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-2f33231f-42d0-4de9-83af-3811a4f39795 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:13.699788 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2f33231f-42d0-4de9-83af-3811a4f39795 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:13.700251 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2f33231f-42d0-4de9-83af-3811a4f39795 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:13.701065 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2f33231f-42d0-4de9-83af-3811a4f39795 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:13.701512 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2f33231f-42d0-4de9-83af-3811a4f39795 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:13.981448 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-2f33231f-42d0-4de9-83af-3811a4f39795 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:13.989458 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-2f33231f-42d0-4de9-83af-3811a4f39795 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.310631 May 17 18:15:13.993765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 173/349] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:13 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:13.999363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4faeeaee-e0ac-4193-ac2d-8823b07c65ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:13.999964 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4faeeaee-e0ac-4193-ac2d-8823b07c65ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:14.006782 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4faeeaee-e0ac-4193-ac2d-8823b07c65ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:14.007400 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4faeeaee-e0ac-4193-ac2d-8823b07c65ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:14.008354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4faeeaee-e0ac-4193-ac2d-8823b07c65ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:14.009263 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4faeeaee-e0ac-4193-ac2d-8823b07c65ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:14.196152 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9e08a42e-58ef-483a-bde2-05b689f7d126 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:14.207527 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9e08a42e-58ef-483a-bde2-05b689f7d126 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:14.211905 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9e08a42e-58ef-483a-bde2-05b689f7d126 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:14.213352 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9e08a42e-58ef-483a-bde2-05b689f7d126 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.707869 May 17 18:15:14.225031 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 177/350] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:13 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:14.299437 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4faeeaee-e0ac-4193-ac2d-8823b07c65ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:14.313431 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4faeeaee-e0ac-4193-ac2d-8823b07c65ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.317148 May 17 18:15:14.325164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 174/351] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:13 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:14.420309 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5c7bc507-237c-4c88-a420-26d4078a525b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:14.420909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5c7bc507-237c-4c88-a420-26d4078a525b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:14.427389 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c7bc507-237c-4c88-a420-26d4078a525b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:14.427834 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c7bc507-237c-4c88-a420-26d4078a525b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:14.428791 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c7bc507-237c-4c88-a420-26d4078a525b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:14.429226 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c7bc507-237c-4c88-a420-26d4078a525b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:14.726483 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5c7bc507-237c-4c88-a420-26d4078a525b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:14.740688 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5c7bc507-237c-4c88-a420-26d4078a525b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.324233 May 17 18:15:14.742907 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 178/352] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:14 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:15.006523 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1e3868ae-a916-4a14-8f91-eb62bf2b8858 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:15.007312 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1e3868ae-a916-4a14-8f91-eb62bf2b8858 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:15.014743 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1e3868ae-a916-4a14-8f91-eb62bf2b8858 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:15.015492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1e3868ae-a916-4a14-8f91-eb62bf2b8858 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:15.016466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1e3868ae-a916-4a14-8f91-eb62bf2b8858 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:15.017224 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1e3868ae-a916-4a14-8f91-eb62bf2b8858 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:15.058468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-786740870", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10e6d493-7166-404c-8c80-451fd67dd6e6"}], "security_groups": [{"name": "tempest-securitygroup--263447664"}], "key_name": "tempest-keypair-1035026411", "user_data": "}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:15.094933 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1e3868ae-a916-4a14-8f91-eb62bf2b8858 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:15.105950 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1e3868ae-a916-4a14-8f91-eb62bf2b8858 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.101908 May 17 18:15:15.114914 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 175/353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:15 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:15.218395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] validate_networks() for [('10e6d493-7166-404c-8c80-451fd67dd6e6', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:15:15.232290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5450f1c2-c585-47ef-ac82-75930461206f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:15.232902 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5450f1c2-c585-47ef-ac82-75930461206f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:15.239362 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5450f1c2-c585-47ef-ac82-75930461206f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:15.239821 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5450f1c2-c585-47ef-ac82-75930461206f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:15.240601 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5450f1c2-c585-47ef-ac82-75930461206f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:15.241040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5450f1c2-c585-47ef-ac82-75930461206f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:15.571011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5450f1c2-c585-47ef-ac82-75930461206f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:15.580772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5450f1c2-c585-47ef-ac82-75930461206f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:15.582679 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5450f1c2-c585-47ef-ac82-75930461206f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:15.583870 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5450f1c2-c585-47ef-ac82-75930461206f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.356216 May 17 18:15:15.585154 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 176/354] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:15 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:15:15.593031 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d58b4664-60a4-429a-80b8-b19f7e3dcd7f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:15.594517 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d58b4664-60a4-429a-80b8-b19f7e3dcd7f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:15.603248 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d58b4664-60a4-429a-80b8-b19f7e3dcd7f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:15.605962 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d58b4664-60a4-429a-80b8-b19f7e3dcd7f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:15.607033 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d58b4664-60a4-429a-80b8-b19f7e3dcd7f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:15.607651 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d58b4664-60a4-429a-80b8-b19f7e3dcd7f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:16.063491 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d58b4664-60a4-429a-80b8-b19f7e3dcd7f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:16.084778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d58b4664-60a4-429a-80b8-b19f7e3dcd7f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.496102 May 17 18:15:16.085566 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 177/355] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:15 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:16.104065 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d6865c5b-6983-4296-b9ce-40126cd0fdd1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:16.104756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d6865c5b-6983-4296-b9ce-40126cd0fdd1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:16.117506 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d6865c5b-6983-4296-b9ce-40126cd0fdd1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:16.118181 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d6865c5b-6983-4296-b9ce-40126cd0fdd1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:16.119319 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d6865c5b-6983-4296-b9ce-40126cd0fdd1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:16.119825 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d6865c5b-6983-4296-b9ce-40126cd0fdd1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:16.282871 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:15:16.283338 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:15:16.283743 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:15:16.284506 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:15:16.284619 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:15:16.302486 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:16.303276 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:16.304945 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:16.305631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:16.346457 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Getting quotas for project e32e7b68f0464827afc5ed835cee1d15. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:15:16.357737 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Getting quotas for user 62a9f27a865b468989f672a05dbab350 and project e32e7b68f0464827afc5ed835cee1d15. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:15:16.375188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:15:16.377484 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:15:16.435158 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-52e79dc2-4b33-4115-88d8-c277c08d4005 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.381855 May 17 18:15:16.436271 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 179/356] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:15:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 18:15:16.440990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-876b7602-bb53-44bb-935c-45b0b2a1cc2f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:16.441617 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-876b7602-bb53-44bb-935c-45b0b2a1cc2f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:16.449322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-876b7602-bb53-44bb-935c-45b0b2a1cc2f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:16.449882 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-876b7602-bb53-44bb-935c-45b0b2a1cc2f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:16.450806 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-876b7602-bb53-44bb-935c-45b0b2a1cc2f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:16.451344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-876b7602-bb53-44bb-935c-45b0b2a1cc2f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:16.452220 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d6865c5b-6983-4296-b9ce-40126cd0fdd1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:16.477428 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d6865c5b-6983-4296-b9ce-40126cd0fdd1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.381258 May 17 18:15:16.491112 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 178/357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:16 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:16.502415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-497427f9-f516-4212-9b95-97f24e1a311f req-bd25e7c8-4137-40fc-91fd-9cfefcf476be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7755ca-b31f-4866-bbad-d9265b908ede", "name": "network-vif-unplugged", "status": "completed", "tag": "07e1d400-b5be-49a9-8446-d004d7659aca"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:16.526310 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-497427f9-f516-4212-9b95-97f24e1a311f req-bd25e7c8-4137-40fc-91fd-9cfefcf476be service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:16.527555 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-497427f9-f516-4212-9b95-97f24e1a311f req-bd25e7c8-4137-40fc-91fd-9cfefcf476be service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:16.549563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-497427f9-f516-4212-9b95-97f24e1a311f req-bd25e7c8-4137-40fc-91fd-9cfefcf476be service nova] Creating event network-vif-unplugged:07e1d400-b5be-49a9-8446-d004d7659aca for instance bd7755ca-b31f-4866-bbad-d9265b908ede on hv-cinder-84130 May 17 18:15:16.555026 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-876b7602-bb53-44bb-935c-45b0b2a1cc2f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:16.555917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-497427f9-f516-4212-9b95-97f24e1a311f req-bd25e7c8-4137-40fc-91fd-9cfefcf476be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063198 May 17 18:15:16.556914 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 179/358] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:16.565740 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f9172a6a-766e-4a2e-ac37-d8728391bc16 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:16.566811 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f9172a6a-766e-4a2e-ac37-d8728391bc16 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:16.576571 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-876b7602-bb53-44bb-935c-45b0b2a1cc2f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.139111 May 17 18:15:16.586358 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 180/359] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:16 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:16.602253 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3a5f6b4d-15e3-43d5-9c92-8d0ab6c2bfc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:16.603392 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3a5f6b4d-15e3-43d5-9c92-8d0ab6c2bfc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:16.611896 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3a5f6b4d-15e3-43d5-9c92-8d0ab6c2bfc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:16.612677 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3a5f6b4d-15e3-43d5-9c92-8d0ab6c2bfc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:16.613778 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3a5f6b4d-15e3-43d5-9c92-8d0ab6c2bfc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:16.614423 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3a5f6b4d-15e3-43d5-9c92-8d0ab6c2bfc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:16.632803 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f9172a6a-766e-4a2e-ac37-d8728391bc16 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:16.648966 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f9172a6a-766e-4a2e-ac37-d8728391bc16 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1245 microversion: 2.1 time: 0.087708 May 17 18:15:16.650532 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 180/360] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:16 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:16.859203 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3a5f6b4d-15e3-43d5-9c92-8d0ab6c2bfc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:16.867169 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3a5f6b4d-15e3-43d5-9c92-8d0ab6c2bfc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:16.868777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3a5f6b4d-15e3-43d5-9c92-8d0ab6c2bfc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:16.871306 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3a5f6b4d-15e3-43d5-9c92-8d0ab6c2bfc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.271694 May 17 18:15:16.871964 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 181/361] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:16 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:15:17.103464 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-66dcf807-6a03-4ef7-9c10-bed9e8a7ddbf tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:17.105626 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-66dcf807-6a03-4ef7-9c10-bed9e8a7ddbf tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:17.113413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66dcf807-6a03-4ef7-9c10-bed9e8a7ddbf tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:17.113872 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66dcf807-6a03-4ef7-9c10-bed9e8a7ddbf tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:17.114676 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66dcf807-6a03-4ef7-9c10-bed9e8a7ddbf tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:17.115118 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66dcf807-6a03-4ef7-9c10-bed9e8a7ddbf tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:17.341489 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-66dcf807-6a03-4ef7-9c10-bed9e8a7ddbf tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:17.351799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-66dcf807-6a03-4ef7-9c10-bed9e8a7ddbf tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.252087 May 17 18:15:17.360023 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 181/362] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:17 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:17.498995 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3c78b583-4135-49e1-95e5-be28810989f1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:17.499767 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3c78b583-4135-49e1-95e5-be28810989f1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:17.506212 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3c78b583-4135-49e1-95e5-be28810989f1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:17.506699 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3c78b583-4135-49e1-95e5-be28810989f1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:17.507471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3c78b583-4135-49e1-95e5-be28810989f1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:17.507906 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3c78b583-4135-49e1-95e5-be28810989f1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:17.593405 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-62b3b947-a625-46a7-8c02-855923eccb06 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:17.594044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-62b3b947-a625-46a7-8c02-855923eccb06 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:17.600270 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-62b3b947-a625-46a7-8c02-855923eccb06 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:17.600789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-62b3b947-a625-46a7-8c02-855923eccb06 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:17.601639 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-62b3b947-a625-46a7-8c02-855923eccb06 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:17.602134 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-62b3b947-a625-46a7-8c02-855923eccb06 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:17.674477 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-62b3b947-a625-46a7-8c02-855923eccb06 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:17.683631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-62b3b947-a625-46a7-8c02-855923eccb06 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.093964 May 17 18:15:17.684227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 182/363] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:17 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:17.690124 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3c78b583-4135-49e1-95e5-be28810989f1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:17.694260 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0ada4a79-98e0-425f-9c17-b39106555aeb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:17.694924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0ada4a79-98e0-425f-9c17-b39106555aeb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:17.698146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3c78b583-4135-49e1-95e5-be28810989f1 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.204364 May 17 18:15:17.698922 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 182/364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:17 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:17.701185 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0ada4a79-98e0-425f-9c17-b39106555aeb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:17.701647 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0ada4a79-98e0-425f-9c17-b39106555aeb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:17.702428 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0ada4a79-98e0-425f-9c17-b39106555aeb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:17.702971 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0ada4a79-98e0-425f-9c17-b39106555aeb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:17.765655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0ada4a79-98e0-425f-9c17-b39106555aeb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:17.773681 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0ada4a79-98e0-425f-9c17-b39106555aeb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1249 microversion: 2.1 time: 0.088137 May 17 18:15:17.774461 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 183/365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:17 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:17.891395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-09b90ea3-a6b3-48ad-9914-6fc450d631ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:17.892144 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-09b90ea3-a6b3-48ad-9914-6fc450d631ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:17.900282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-09b90ea3-a6b3-48ad-9914-6fc450d631ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:17.900828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-09b90ea3-a6b3-48ad-9914-6fc450d631ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:17.902618 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-09b90ea3-a6b3-48ad-9914-6fc450d631ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:17.903125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-09b90ea3-a6b3-48ad-9914-6fc450d631ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:18.080064 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-09b90ea3-a6b3-48ad-9914-6fc450d631ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:18.090450 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-09b90ea3-a6b3-48ad-9914-6fc450d631ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:18.095081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-09b90ea3-a6b3-48ad-9914-6fc450d631ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:18.096692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-09b90ea3-a6b3-48ad-9914-6fc450d631ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.211330 May 17 18:15:18.111010 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 183/366] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:17 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:18.371740 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-24734894-51d0-4a0f-979c-ecf70d6480fe tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:18.373043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-24734894-51d0-4a0f-979c-ecf70d6480fe tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:18.400076 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-24734894-51d0-4a0f-979c-ecf70d6480fe tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:18.403598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-24734894-51d0-4a0f-979c-ecf70d6480fe tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:18.404867 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-24734894-51d0-4a0f-979c-ecf70d6480fe tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:18.405621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-24734894-51d0-4a0f-979c-ecf70d6480fe tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:18.574906 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-24734894-51d0-4a0f-979c-ecf70d6480fe tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:18.583141 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-24734894-51d0-4a0f-979c-ecf70d6480fe tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.216553 May 17 18:15:18.585977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 184/367] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:18 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:18.701123 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-928501df-d55c-4c00-9390-5ac4c50c8d1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:18.702421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-928501df-d55c-4c00-9390-5ac4c50c8d1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:18.709878 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-928501df-d55c-4c00-9390-5ac4c50c8d1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:18.715770 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a5f01493-b608-45c4-bf24-66e723c235e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:18.717417 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a5f01493-b608-45c4-bf24-66e723c235e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:18.720749 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-928501df-d55c-4c00-9390-5ac4c50c8d1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:18.724228 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a5f01493-b608-45c4-bf24-66e723c235e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:18.724678 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a5f01493-b608-45c4-bf24-66e723c235e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:18.725754 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-928501df-d55c-4c00-9390-5ac4c50c8d1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:18.726361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-928501df-d55c-4c00-9390-5ac4c50c8d1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:18.731051 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a5f01493-b608-45c4-bf24-66e723c235e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:18.731502 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a5f01493-b608-45c4-bf24-66e723c235e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:18.841772 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-928501df-d55c-4c00-9390-5ac4c50c8d1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:18.851689 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-928501df-d55c-4c00-9390-5ac4c50c8d1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.154664 May 17 18:15:18.852502 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 184/368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:18 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:18.863408 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9c6fa91d-c185-40f1-81a5-cae2081196f2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:18.864529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9c6fa91d-c185-40f1-81a5-cae2081196f2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:18.883730 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9c6fa91d-c185-40f1-81a5-cae2081196f2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:18.884482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9c6fa91d-c185-40f1-81a5-cae2081196f2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:18.885529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9c6fa91d-c185-40f1-81a5-cae2081196f2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:18.886130 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9c6fa91d-c185-40f1-81a5-cae2081196f2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:18.913276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a5f01493-b608-45c4-bf24-66e723c235e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:18.921830 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a5f01493-b608-45c4-bf24-66e723c235e8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.210461 May 17 18:15:18.925390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 185/369] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:18 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:18.986491 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9c6fa91d-c185-40f1-81a5-cae2081196f2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:18.993954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9c6fa91d-c185-40f1-81a5-cae2081196f2 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1249 microversion: 2.1 time: 0.138705 May 17 18:15:18.994531 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 185/370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:18 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1249 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:19.116031 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-88075814-9880-4c4f-af6c-cb91e179c1b2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:19.116825 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-88075814-9880-4c4f-af6c-cb91e179c1b2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:19.125842 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-88075814-9880-4c4f-af6c-cb91e179c1b2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:19.127780 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-88075814-9880-4c4f-af6c-cb91e179c1b2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:19.128712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-88075814-9880-4c4f-af6c-cb91e179c1b2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:19.129641 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-88075814-9880-4c4f-af6c-cb91e179c1b2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:19.372794 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-88075814-9880-4c4f-af6c-cb91e179c1b2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:19.384084 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-88075814-9880-4c4f-af6c-cb91e179c1b2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:19.386629 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-88075814-9880-4c4f-af6c-cb91e179c1b2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:19.388199 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-88075814-9880-4c4f-af6c-cb91e179c1b2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.276054 May 17 18:15:19.389340 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 186/371] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:19 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:15:19.602803 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2330f78f-2dde-4058-9d4e-82573ecc15d2 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:19.603763 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2330f78f-2dde-4058-9d4e-82573ecc15d2 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:19.611276 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2330f78f-2dde-4058-9d4e-82573ecc15d2 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:19.612065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2330f78f-2dde-4058-9d4e-82573ecc15d2 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:19.613069 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2330f78f-2dde-4058-9d4e-82573ecc15d2 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:19.613711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2330f78f-2dde-4058-9d4e-82573ecc15d2 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:19.840470 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2330f78f-2dde-4058-9d4e-82573ecc15d2 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:19.852294 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2330f78f-2dde-4058-9d4e-82573ecc15d2 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.253266 May 17 18:15:19.857824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 186/372] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:19 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:19.869074 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0c53db00-9831-4843-9392-a331c49394df tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:19.870479 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0c53db00-9831-4843-9392-a331c49394df tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:19.877773 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0c53db00-9831-4843-9392-a331c49394df tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:19.878227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0c53db00-9831-4843-9392-a331c49394df tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:19.879044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0c53db00-9831-4843-9392-a331c49394df tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:19.879479 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0c53db00-9831-4843-9392-a331c49394df tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:19.943867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c0e04aa7-91d1-465a-ac54-1ec00fde0d8d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:19.946644 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c0e04aa7-91d1-465a-ac54-1ec00fde0d8d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:19.960719 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c0e04aa7-91d1-465a-ac54-1ec00fde0d8d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:19.965814 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c0e04aa7-91d1-465a-ac54-1ec00fde0d8d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:19.974090 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c0e04aa7-91d1-465a-ac54-1ec00fde0d8d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:19.974974 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c0e04aa7-91d1-465a-ac54-1ec00fde0d8d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:20.011136 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0c53db00-9831-4843-9392-a331c49394df tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:20.030144 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0c53db00-9831-4843-9392-a331c49394df tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.164751 May 17 18:15:20.046896 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 187/373] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:19 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:20.052022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ab9d1434-9a62-45a4-b4ea-d15c1ff1c777 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:20.052911 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ab9d1434-9a62-45a4-b4ea-d15c1ff1c777 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:20.059515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab9d1434-9a62-45a4-b4ea-d15c1ff1c777 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:20.060273 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab9d1434-9a62-45a4-b4ea-d15c1ff1c777 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:20.068018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab9d1434-9a62-45a4-b4ea-d15c1ff1c777 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:20.072330 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab9d1434-9a62-45a4-b4ea-d15c1ff1c777 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:20.186129 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ab9d1434-9a62-45a4-b4ea-d15c1ff1c777 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:20.197112 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ab9d1434-9a62-45a4-b4ea-d15c1ff1c777 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1249 microversion: 2.1 time: 0.148800 May 17 18:15:20.209597 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 188/374] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:20 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1249 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:20.261965 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c0e04aa7-91d1-465a-ac54-1ec00fde0d8d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:20.270697 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c0e04aa7-91d1-465a-ac54-1ec00fde0d8d tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.333308 May 17 18:15:20.271843 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 187/375] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:19 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:20.409333 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-2b485411-2176-45be-af37-5ff356c6ea37 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:20.410632 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-2b485411-2176-45be-af37-5ff356c6ea37 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:20.423027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2b485411-2176-45be-af37-5ff356c6ea37 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:20.423748 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2b485411-2176-45be-af37-5ff356c6ea37 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:20.424700 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2b485411-2176-45be-af37-5ff356c6ea37 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:20.425134 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2b485411-2176-45be-af37-5ff356c6ea37 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:20.613412 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-2b485411-2176-45be-af37-5ff356c6ea37 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:20.623794 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-2b485411-2176-45be-af37-5ff356c6ea37 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:20.625310 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-2b485411-2176-45be-af37-5ff356c6ea37 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:20.626772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-2b485411-2176-45be-af37-5ff356c6ea37 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.221275 May 17 18:15:20.627333 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 189/376] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:20 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:20.876266 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-76567ec7-bd49-4e78-8ea6-224271ec8aa7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:20.877647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-76567ec7-bd49-4e78-8ea6-224271ec8aa7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:20.888363 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76567ec7-bd49-4e78-8ea6-224271ec8aa7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:20.889089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76567ec7-bd49-4e78-8ea6-224271ec8aa7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:20.890061 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76567ec7-bd49-4e78-8ea6-224271ec8aa7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:20.890678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76567ec7-bd49-4e78-8ea6-224271ec8aa7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:21.048838 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5555432d-d00c-443f-ac56-9404e6effd4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:21.053363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5555432d-d00c-443f-ac56-9404e6effd4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:21.063017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5555432d-d00c-443f-ac56-9404e6effd4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:21.063711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5555432d-d00c-443f-ac56-9404e6effd4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:21.064492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5555432d-d00c-443f-ac56-9404e6effd4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:21.065079 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5555432d-d00c-443f-ac56-9404e6effd4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:21.073363 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-76567ec7-bd49-4e78-8ea6-224271ec8aa7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:21.084968 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-76567ec7-bd49-4e78-8ea6-224271ec8aa7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.212968 May 17 18:15:21.096277 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 188/377] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:20 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:21.148019 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5555432d-d00c-443f-ac56-9404e6effd4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:21.157408 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5555432d-d00c-443f-ac56-9404e6effd4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.112109 May 17 18:15:21.158145 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 190/378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:21 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:21.215498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-75e4814d-79aa-4a84-9c92-1b4e1cf459e4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:21.216117 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-75e4814d-79aa-4a84-9c92-1b4e1cf459e4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:21.222356 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75e4814d-79aa-4a84-9c92-1b4e1cf459e4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:21.222840 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75e4814d-79aa-4a84-9c92-1b4e1cf459e4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:21.235703 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75e4814d-79aa-4a84-9c92-1b4e1cf459e4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:21.236165 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75e4814d-79aa-4a84-9c92-1b4e1cf459e4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:21.287836 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9c86cc38-c2d1-4218-8d04-08104cce76b4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:21.288717 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9c86cc38-c2d1-4218-8d04-08104cce76b4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:21.298919 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9c86cc38-c2d1-4218-8d04-08104cce76b4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:21.299764 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9c86cc38-c2d1-4218-8d04-08104cce76b4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:21.300594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9c86cc38-c2d1-4218-8d04-08104cce76b4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:21.301037 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9c86cc38-c2d1-4218-8d04-08104cce76b4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:21.327207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-75e4814d-79aa-4a84-9c92-1b4e1cf459e4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:21.337257 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-75e4814d-79aa-4a84-9c92-1b4e1cf459e4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1249 microversion: 2.1 time: 0.125661 May 17 18:15:21.337910 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 189/379] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:21 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1249 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:21.497326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9c86cc38-c2d1-4218-8d04-08104cce76b4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:21.507193 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9c86cc38-c2d1-4218-8d04-08104cce76b4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.223186 May 17 18:15:21.509472 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 191/380] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:21 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:21.645259 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4a6fd834-6787-4150-9f0a-1edd17289ae1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:21.645991 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4a6fd834-6787-4150-9f0a-1edd17289ae1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:21.652580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4a6fd834-6787-4150-9f0a-1edd17289ae1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:21.656489 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4a6fd834-6787-4150-9f0a-1edd17289ae1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:21.657384 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4a6fd834-6787-4150-9f0a-1edd17289ae1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:21.657824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4a6fd834-6787-4150-9f0a-1edd17289ae1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:21.801832 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4a6fd834-6787-4150-9f0a-1edd17289ae1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:21.813907 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4a6fd834-6787-4150-9f0a-1edd17289ae1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:21.815821 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4a6fd834-6787-4150-9f0a-1edd17289ae1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:21.817138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4a6fd834-6787-4150-9f0a-1edd17289ae1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.175770 May 17 18:15:21.818653 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 190/381] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:21 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:22.103146 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-730443f1-b551-4158-9caa-e711c8174236 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:22.103755 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-730443f1-b551-4158-9caa-e711c8174236 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:22.111233 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-730443f1-b551-4158-9caa-e711c8174236 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:22.111914 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-730443f1-b551-4158-9caa-e711c8174236 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:22.112871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-730443f1-b551-4158-9caa-e711c8174236 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:22.113310 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-730443f1-b551-4158-9caa-e711c8174236 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:22.176901 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1379bee2-0d1a-4edd-88c1-8fda3a71f76a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:22.178379 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1379bee2-0d1a-4edd-88c1-8fda3a71f76a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:22.192819 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1379bee2-0d1a-4edd-88c1-8fda3a71f76a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:22.193646 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1379bee2-0d1a-4edd-88c1-8fda3a71f76a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:22.195604 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1379bee2-0d1a-4edd-88c1-8fda3a71f76a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:22.196311 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1379bee2-0d1a-4edd-88c1-8fda3a71f76a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:22.291274 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1379bee2-0d1a-4edd-88c1-8fda3a71f76a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:22.299079 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1379bee2-0d1a-4edd-88c1-8fda3a71f76a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.126395 May 17 18:15:22.300255 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 191/382] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:22 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:22.319882 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-730443f1-b551-4158-9caa-e711c8174236 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:22.328654 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-730443f1-b551-4158-9caa-e711c8174236 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.229310 May 17 18:15:22.338280 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 192/383] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:22 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:22.355208 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-af73d089-446d-4f2b-9d36-e4f8b7af4eb5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:22.356144 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-af73d089-446d-4f2b-9d36-e4f8b7af4eb5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:22.362421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-af73d089-446d-4f2b-9d36-e4f8b7af4eb5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:22.362906 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-af73d089-446d-4f2b-9d36-e4f8b7af4eb5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:22.363673 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-af73d089-446d-4f2b-9d36-e4f8b7af4eb5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:22.364111 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-af73d089-446d-4f2b-9d36-e4f8b7af4eb5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:22.428580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-af73d089-446d-4f2b-9d36-e4f8b7af4eb5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:22.437752 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-af73d089-446d-4f2b-9d36-e4f8b7af4eb5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1249 microversion: 2.1 time: 0.086810 May 17 18:15:22.438536 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 192/384] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:22 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:22.526691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d6975d74-e0cd-4be7-910f-9e749b9d0ed8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:22.527376 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d6975d74-e0cd-4be7-910f-9e749b9d0ed8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:22.533358 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d6975d74-e0cd-4be7-910f-9e749b9d0ed8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:22.533816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d6975d74-e0cd-4be7-910f-9e749b9d0ed8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:22.534974 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d6975d74-e0cd-4be7-910f-9e749b9d0ed8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:22.536441 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d6975d74-e0cd-4be7-910f-9e749b9d0ed8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:22.693849 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d6975d74-e0cd-4be7-910f-9e749b9d0ed8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:22.701705 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d6975d74-e0cd-4be7-910f-9e749b9d0ed8 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.179783 May 17 18:15:22.702272 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 193/385] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:22 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:22.835535 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-79925aec-ef84-4085-853c-ba7bb16ef2e3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:22.836147 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-79925aec-ef84-4085-853c-ba7bb16ef2e3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:22.842934 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79925aec-ef84-4085-853c-ba7bb16ef2e3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:22.843394 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79925aec-ef84-4085-853c-ba7bb16ef2e3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:22.844177 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79925aec-ef84-4085-853c-ba7bb16ef2e3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:22.844623 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79925aec-ef84-4085-853c-ba7bb16ef2e3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:22.996758 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-79925aec-ef84-4085-853c-ba7bb16ef2e3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:23.007663 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-79925aec-ef84-4085-853c-ba7bb16ef2e3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:23.009454 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-79925aec-ef84-4085-853c-ba7bb16ef2e3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:23.011487 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-79925aec-ef84-4085-853c-ba7bb16ef2e3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.179813 May 17 18:15:23.012174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 193/386] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:22 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:23.319283 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0d6ff771-8143-49cd-b176-5cd4098a2364 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:23.320299 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0d6ff771-8143-49cd-b176-5cd4098a2364 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:23.328019 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d6ff771-8143-49cd-b176-5cd4098a2364 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:23.328543 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d6ff771-8143-49cd-b176-5cd4098a2364 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:23.329391 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d6ff771-8143-49cd-b176-5cd4098a2364 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:23.329897 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d6ff771-8143-49cd-b176-5cd4098a2364 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:23.345714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b2175a20-05b3-4798-a269-fdc3df5a84b9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:23.347181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b2175a20-05b3-4798-a269-fdc3df5a84b9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:23.357852 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b2175a20-05b3-4798-a269-fdc3df5a84b9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:23.358789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b2175a20-05b3-4798-a269-fdc3df5a84b9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:23.359805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b2175a20-05b3-4798-a269-fdc3df5a84b9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:23.360434 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b2175a20-05b3-4798-a269-fdc3df5a84b9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:23.409222 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0d6ff771-8143-49cd-b176-5cd4098a2364 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:23.420494 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0d6ff771-8143-49cd-b176-5cd4098a2364 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1245 microversion: 2.1 time: 0.106962 May 17 18:15:23.421826 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 194/387] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:23 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:23.454888 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4dd0dee8-fc43-4fc8-bc1c-03eb570deffd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:23.455819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4dd0dee8-fc43-4fc8-bc1c-03eb570deffd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:23.461956 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4dd0dee8-fc43-4fc8-bc1c-03eb570deffd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:23.462650 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4dd0dee8-fc43-4fc8-bc1c-03eb570deffd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:23.464341 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4dd0dee8-fc43-4fc8-bc1c-03eb570deffd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:23.464971 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4dd0dee8-fc43-4fc8-bc1c-03eb570deffd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:23.549718 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4dd0dee8-fc43-4fc8-bc1c-03eb570deffd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:23.562225 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4dd0dee8-fc43-4fc8-bc1c-03eb570deffd tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1249 microversion: 2.1 time: 0.111424 May 17 18:15:23.567044 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b2175a20-05b3-4798-a269-fdc3df5a84b9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:23.573930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 195/388] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:23 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1249 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:23.587316 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b2175a20-05b3-4798-a269-fdc3df5a84b9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.245457 May 17 18:15:23.594443 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 194/389] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:23 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:23.719498 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0a064212-34c4-4d12-b8d1-2060940f68af tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:23.720105 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0a064212-34c4-4d12-b8d1-2060940f68af tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:23.726374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0a064212-34c4-4d12-b8d1-2060940f68af tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:23.726908 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0a064212-34c4-4d12-b8d1-2060940f68af tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:23.727687 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0a064212-34c4-4d12-b8d1-2060940f68af tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:23.728121 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0a064212-34c4-4d12-b8d1-2060940f68af tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:23.896463 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0a064212-34c4-4d12-b8d1-2060940f68af tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:23.906606 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0a064212-34c4-4d12-b8d1-2060940f68af tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.190393 May 17 18:15:23.906606 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 196/390] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:23 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:24.035058 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6eef97da-33e8-4412-b32b-1ef0ed195878 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:24.036269 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6eef97da-33e8-4412-b32b-1ef0ed195878 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:24.046975 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6eef97da-33e8-4412-b32b-1ef0ed195878 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:24.046975 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6eef97da-33e8-4412-b32b-1ef0ed195878 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:24.048550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6eef97da-33e8-4412-b32b-1ef0ed195878 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:24.048550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6eef97da-33e8-4412-b32b-1ef0ed195878 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:24.248512 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6eef97da-33e8-4412-b32b-1ef0ed195878 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:24.258905 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6eef97da-33e8-4412-b32b-1ef0ed195878 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:24.261330 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6eef97da-33e8-4412-b32b-1ef0ed195878 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:24.263287 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6eef97da-33e8-4412-b32b-1ef0ed195878 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.235739 May 17 18:15:24.264236 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 195/391] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:24 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:24.440138 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e5eb9fc9-51aa-46cf-b90b-5fd038ca1943 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:24.440770 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e5eb9fc9-51aa-46cf-b90b-5fd038ca1943 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:24.452857 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5eb9fc9-51aa-46cf-b90b-5fd038ca1943 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:24.453313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5eb9fc9-51aa-46cf-b90b-5fd038ca1943 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:24.454115 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5eb9fc9-51aa-46cf-b90b-5fd038ca1943 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:24.454556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5eb9fc9-51aa-46cf-b90b-5fd038ca1943 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:24.572042 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e5eb9fc9-51aa-46cf-b90b-5fd038ca1943 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:24.582901 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a7488468-c877-447b-a8f4-fba039390261 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:24.583473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e5eb9fc9-51aa-46cf-b90b-5fd038ca1943 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1293 microversion: 2.1 time: 0.146627 May 17 18:15:24.583569 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a7488468-c877-447b-a8f4-fba039390261 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:24.594464 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a7488468-c877-447b-a8f4-fba039390261 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:24.595059 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 197/392] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:24 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:24.595390 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a7488468-c877-447b-a8f4-fba039390261 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:24.596395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a7488468-c877-447b-a8f4-fba039390261 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:24.599223 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a7488468-c877-447b-a8f4-fba039390261 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:24.610539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3e44ae2e-3171-4987-9a22-d0ed95f47189 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:24.611173 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3e44ae2e-3171-4987-9a22-d0ed95f47189 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:24.618148 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3e44ae2e-3171-4987-9a22-d0ed95f47189 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:24.618614 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3e44ae2e-3171-4987-9a22-d0ed95f47189 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:24.620188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3e44ae2e-3171-4987-9a22-d0ed95f47189 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:24.620691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3e44ae2e-3171-4987-9a22-d0ed95f47189 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:24.737123 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a7488468-c877-447b-a8f4-fba039390261 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:24.755307 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a7488468-c877-447b-a8f4-fba039390261 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1297 microversion: 2.1 time: 0.178066 May 17 18:15:24.755912 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 196/393] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:24 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1297 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:24.868065 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3e44ae2e-3171-4987-9a22-d0ed95f47189 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:24.880763 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3e44ae2e-3171-4987-9a22-d0ed95f47189 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.274613 May 17 18:15:24.884884 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 198/394] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:24 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:24.928760 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-080a7d50-0e31-461d-8601-5eb67dcaf0ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:24.929265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-080a7d50-0e31-461d-8601-5eb67dcaf0ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:24.938293 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-080a7d50-0e31-461d-8601-5eb67dcaf0ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:24.938777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-080a7d50-0e31-461d-8601-5eb67dcaf0ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:24.939563 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-080a7d50-0e31-461d-8601-5eb67dcaf0ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:24.940006 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-080a7d50-0e31-461d-8601-5eb67dcaf0ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:25.192953 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-080a7d50-0e31-461d-8601-5eb67dcaf0ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:25.200913 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-080a7d50-0e31-461d-8601-5eb67dcaf0ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1513 microversion: 2.1 time: 0.282828 May 17 18:15:25.210481 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 197/395] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:24 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:25.282453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-dc01a59b-6ca7-4610-a72d-38fe96f42fb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:25.283137 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-dc01a59b-6ca7-4610-a72d-38fe96f42fb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:25.300457 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc01a59b-6ca7-4610-a72d-38fe96f42fb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:25.300915 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc01a59b-6ca7-4610-a72d-38fe96f42fb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:25.301711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc01a59b-6ca7-4610-a72d-38fe96f42fb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:25.302149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc01a59b-6ca7-4610-a72d-38fe96f42fb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:25.312699 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-7a6fdf5a-f461-4e23-b4f5-ba101ac52bc6 req-461af739-10f6-4ed3-83f2-677ccfe1988b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7755ca-b31f-4866-bbad-d9265b908ede", "name": "network-vif-deleted", "tag": "07e1d400-b5be-49a9-8446-d004d7659aca"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:25.329934 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-7a6fdf5a-f461-4e23-b4f5-ba101ac52bc6 req-461af739-10f6-4ed3-83f2-677ccfe1988b service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:25.334781 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-7a6fdf5a-f461-4e23-b4f5-ba101ac52bc6 req-461af739-10f6-4ed3-83f2-677ccfe1988b service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:25.349771 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-7a6fdf5a-f461-4e23-b4f5-ba101ac52bc6 req-461af739-10f6-4ed3-83f2-677ccfe1988b service nova] Creating event network-vif-deleted:07e1d400-b5be-49a9-8446-d004d7659aca for instance bd7755ca-b31f-4866-bbad-d9265b908ede on hv-cinder-84130 May 17 18:15:25.379664 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-7a6fdf5a-f461-4e23-b4f5-ba101ac52bc6 req-461af739-10f6-4ed3-83f2-677ccfe1988b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070431 May 17 18:15:25.395009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 198/396] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:15:25.489982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-dc01a59b-6ca7-4610-a72d-38fe96f42fb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:25.500172 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-dc01a59b-6ca7-4610-a72d-38fe96f42fb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:25.501740 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-dc01a59b-6ca7-4610-a72d-38fe96f42fb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:25.503913 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-dc01a59b-6ca7-4610-a72d-38fe96f42fb2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1742 microversion: 2.20 time: 0.225540 May 17 18:15:25.504965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 199/397] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:25 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1742 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:25.602339 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a8a254b2-225f-45ef-b209-3895deb9f842 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:25.602929 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a8a254b2-225f-45ef-b209-3895deb9f842 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:25.609424 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8a254b2-225f-45ef-b209-3895deb9f842 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:25.609885 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8a254b2-225f-45ef-b209-3895deb9f842 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:25.610907 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8a254b2-225f-45ef-b209-3895deb9f842 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:25.611522 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8a254b2-225f-45ef-b209-3895deb9f842 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:25.708312 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a8a254b2-225f-45ef-b209-3895deb9f842 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:25.717055 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a8a254b2-225f-45ef-b209-3895deb9f842 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1299 microversion: 2.1 time: 0.119257 May 17 18:15:25.717637 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 199/398] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:25 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:25.774781 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-eeb873b9-4658-47df-a1aa-8b2c2176e319 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:25.776555 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-eeb873b9-4658-47df-a1aa-8b2c2176e319 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:25.785071 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eeb873b9-4658-47df-a1aa-8b2c2176e319 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:25.785520 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eeb873b9-4658-47df-a1aa-8b2c2176e319 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:25.786295 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eeb873b9-4658-47df-a1aa-8b2c2176e319 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:25.794234 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eeb873b9-4658-47df-a1aa-8b2c2176e319 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:25.887411 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-eeb873b9-4658-47df-a1aa-8b2c2176e319 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:25.898952 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-eeb873b9-4658-47df-a1aa-8b2c2176e319 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1303 microversion: 2.1 time: 0.129363 May 17 18:15:25.900141 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 200/399] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:25 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:25.903235 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-330714d5-d74c-4cb5-a779-ed1e8a0792bb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:25.904081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-330714d5-d74c-4cb5-a779-ed1e8a0792bb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:25.910204 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-330714d5-d74c-4cb5-a779-ed1e8a0792bb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:25.911089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-330714d5-d74c-4cb5-a779-ed1e8a0792bb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:25.912077 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-330714d5-d74c-4cb5-a779-ed1e8a0792bb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:25.912508 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-330714d5-d74c-4cb5-a779-ed1e8a0792bb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:26.089330 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-330714d5-d74c-4cb5-a779-ed1e8a0792bb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:26.100576 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-330714d5-d74c-4cb5-a779-ed1e8a0792bb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.202730 May 17 18:15:26.112844 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 200/400] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:25 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:26.219584 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:26.220702 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:26.232805 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:26.234274 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:26.236073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:26.237948 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:26.304082 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:26.304893 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:26.305566 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lazy-loading 'fault' on Instance uuid bd7755ca-b31f-4866-bbad-d9265b908ede {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:15:26.371870 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:26.382616 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-794feb28-ca35-427b-9a39-3c9e001af334 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 200 len: 1309 microversion: 2.1 time: 0.168032 May 17 18:15:26.396266 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 201/401] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:26 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 1309 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:26.524144 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c5dcc524-2cce-4da1-9561-bdf905262103 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:26.525699 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c5dcc524-2cce-4da1-9561-bdf905262103 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:26.533047 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5dcc524-2cce-4da1-9561-bdf905262103 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:26.533827 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5dcc524-2cce-4da1-9561-bdf905262103 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:26.534888 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5dcc524-2cce-4da1-9561-bdf905262103 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:26.535747 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5dcc524-2cce-4da1-9561-bdf905262103 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:26.736326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-692bd103-3a55-4acc-8acd-f84c27a0f554 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:26.737734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-692bd103-3a55-4acc-8acd-f84c27a0f554 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:26.749772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-692bd103-3a55-4acc-8acd-f84c27a0f554 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:26.750689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-692bd103-3a55-4acc-8acd-f84c27a0f554 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:26.751748 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-692bd103-3a55-4acc-8acd-f84c27a0f554 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:26.752582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-692bd103-3a55-4acc-8acd-f84c27a0f554 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:26.757524 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c5dcc524-2cce-4da1-9561-bdf905262103 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:26.772982 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c5dcc524-2cce-4da1-9561-bdf905262103 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:26.774611 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c5dcc524-2cce-4da1-9561-bdf905262103 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:26.775970 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c5dcc524-2cce-4da1-9561-bdf905262103 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1742 microversion: 2.20 time: 0.257118 May 17 18:15:26.776625 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 201/402] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:26 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1742 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:26.916990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5fb8831c-d3e4-4136-bd6b-f9911be6428f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:26.917612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5fb8831c-d3e4-4136-bd6b-f9911be6428f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:26.924380 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5fb8831c-d3e4-4136-bd6b-f9911be6428f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:26.924834 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5fb8831c-d3e4-4136-bd6b-f9911be6428f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:26.925611 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5fb8831c-d3e4-4136-bd6b-f9911be6428f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:26.926051 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5fb8831c-d3e4-4136-bd6b-f9911be6428f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:26.954697 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-692bd103-3a55-4acc-8acd-f84c27a0f554 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:26.967567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-692bd103-3a55-4acc-8acd-f84c27a0f554 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.235116 May 17 18:15:26.975771 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 202/403] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:26 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:27.120369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-08069afd-1568-4b6a-9c6a-bb8defb8f5cb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:27.121747 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-08069afd-1568-4b6a-9c6a-bb8defb8f5cb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:27.134003 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08069afd-1568-4b6a-9c6a-bb8defb8f5cb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:27.134764 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08069afd-1568-4b6a-9c6a-bb8defb8f5cb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:27.140757 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08069afd-1568-4b6a-9c6a-bb8defb8f5cb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:27.141227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08069afd-1568-4b6a-9c6a-bb8defb8f5cb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:27.195730 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5fb8831c-d3e4-4136-bd6b-f9911be6428f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:27.205721 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5fb8831c-d3e4-4136-bd6b-f9911be6428f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.292759 May 17 18:15:27.217695 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 202/404] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:26 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:27.405654 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2be40983-8894-42f8-869b-c00177d78ce4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:27.406463 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2be40983-8894-42f8-869b-c00177d78ce4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: bd7755ca-b31f-4866-bbad-d9265b908ede] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:27.420756 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2be40983-8894-42f8-869b-c00177d78ce4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:27.424040 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2be40983-8894-42f8-869b-c00177d78ce4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:27.427008 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2be40983-8894-42f8-869b-c00177d78ce4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:27.427652 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2be40983-8894-42f8-869b-c00177d78ce4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:27.481809 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-08069afd-1568-4b6a-9c6a-bb8defb8f5cb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:27.490287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-08069afd-1568-4b6a-9c6a-bb8defb8f5cb tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.374733 May 17 18:15:27.490890 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 203/405] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:27 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:27.507535 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-2be40983-8894-42f8-869b-c00177d78ce4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] HTTP exception thrown: Instance bd7755ca-b31f-4866-bbad-d9265b908ede could not be found. May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2be40983-8894-42f8-869b-c00177d78ce4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Request method failure captured: May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede HTTP/1.1 May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-XauW4yz2ALvwreTLSIoWo_1KdDeipqYgqvntl_xcWXUSMUIVh-fWIRlbkHAIlwKX8T0NGz6CZQwrteBpG5rvxMuGxjhVklVZcKzL38BqG8DQ9B-Ni6ELco0fCVMkKWVs9inNaYNq38q3Z6Y2ZVEwtuI19cfabQc6ZM2MO1LescWzc May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 76d421fe5f96421db7d4eeedd205b462 May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1362036592 May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:15:27.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76d421fe5f96421db7d4eeedd205b462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76d421fe5f96421db7d4eeedd205b462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76d421fe5f96421db7d4eeedd205b462"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76d421fe5f96421db7d4eeedd205b462", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-VolumesSnapshotTestJSON-1362036592 May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 76d421fe5f96421db7d4eeedd205b462 May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1362036592 May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-VolumesSnapshotTestJSON-1362036592-project May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: fc7eae5aa3594459bea417a96aae7d8d May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-VolumesSnapshotTestJSON-1362036592-project May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance bd7755ca-b31f-4866-bbad-d9265b908ede could not be found. May 17 18:15:27.511342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': 'bd7755ca-b31f-4866-bbad-d9265b908ede'} May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7755ca-b31f-4866-bbad-d9265b908ede could not be found. May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:15:27.512285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7755ca-b31f-4866-bbad-d9265b908ede could not be found. May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7755ca-b31f-4866-bbad-d9265b908ede could not be found. May 17 18:15:27.513986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:15:27.516794 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2be40983-8894-42f8-869b-c00177d78ce4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Returning 404 to user: Instance bd7755ca-b31f-4866-bbad-d9265b908ede could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:15:27.517988 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2be40983-8894-42f8-869b-c00177d78ce4 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede" status: 404 len: 111 microversion: 2.1 time: 0.117098 May 17 18:15:27.519054 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 203/406] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:27 2022] GET /compute/v2.1/servers/bd7755ca-b31f-4866-bbad-d9265b908ede => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 18:15:27.794234 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a27d3a62-84b3-4bfc-8774-abafc2a51022 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:27.795122 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a27d3a62-84b3-4bfc-8774-abafc2a51022 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:27.815177 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a27d3a62-84b3-4bfc-8774-abafc2a51022 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:27.815836 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a27d3a62-84b3-4bfc-8774-abafc2a51022 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:27.818858 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a27d3a62-84b3-4bfc-8774-abafc2a51022 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:27.819418 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a27d3a62-84b3-4bfc-8774-abafc2a51022 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:27.998986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-49ac36b9-b5ad-4243-b7f8-ff637149c12e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:28.005354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-49ac36b9-b5ad-4243-b7f8-ff637149c12e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:28.014817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-49ac36b9-b5ad-4243-b7f8-ff637149c12e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:28.015551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-49ac36b9-b5ad-4243-b7f8-ff637149c12e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:28.016576 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-49ac36b9-b5ad-4243-b7f8-ff637149c12e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:28.017228 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-49ac36b9-b5ad-4243-b7f8-ff637149c12e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:28.226409 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a27d3a62-84b3-4bfc-8774-abafc2a51022 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:28.261525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a27d3a62-84b3-4bfc-8774-abafc2a51022 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:28.263698 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a27d3a62-84b3-4bfc-8774-abafc2a51022 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:28.265131 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a27d3a62-84b3-4bfc-8774-abafc2a51022 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.475757 May 17 18:15:28.282455 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 204/407] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:27 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:28.288106 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ad59ee8a-1fc3-459b-a272-8716d97e7a83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:28.289003 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ad59ee8a-1fc3-459b-a272-8716d97e7a83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:28.343776 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad59ee8a-1fc3-459b-a272-8716d97e7a83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:28.352694 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad59ee8a-1fc3-459b-a272-8716d97e7a83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:28.353795 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad59ee8a-1fc3-459b-a272-8716d97e7a83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:28.358006 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad59ee8a-1fc3-459b-a272-8716d97e7a83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:28.368715 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-49ac36b9-b5ad-4243-b7f8-ff637149c12e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:28.377501 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-49ac36b9-b5ad-4243-b7f8-ff637149c12e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.398533 May 17 18:15:28.391012 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 204/408] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:27 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:28.509496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9a48f522-5876-4c0c-a5c0-1381ebb1209e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:28.513970 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9a48f522-5876-4c0c-a5c0-1381ebb1209e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:28.539079 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9a48f522-5876-4c0c-a5c0-1381ebb1209e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:28.543870 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9a48f522-5876-4c0c-a5c0-1381ebb1209e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:28.545418 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9a48f522-5876-4c0c-a5c0-1381ebb1209e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:28.548705 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9a48f522-5876-4c0c-a5c0-1381ebb1209e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:28.711835 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ad59ee8a-1fc3-459b-a272-8716d97e7a83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:28.740852 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ad59ee8a-1fc3-459b-a272-8716d97e7a83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.455342 May 17 18:15:28.747039 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 205/409] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:28 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:28.949146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9a48f522-5876-4c0c-a5c0-1381ebb1209e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:28.974741 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9a48f522-5876-4c0c-a5c0-1381ebb1209e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.462046 May 17 18:15:28.975802 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 205/410] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:28 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:29.195838 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-3b90668b-4d80-48e0-85e0-b4fe74ce1bb4 req-55f5b250-93c7-4efb-9bb8-d303dc63ef67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1966aa90-f5e3-4591-8105-69f6cc0fbdfb", "tag": "c45336db-0e36-4d75-8c9b-f63dc16532f1"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:29.221910 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-3b90668b-4d80-48e0-85e0-b4fe74ce1bb4 req-55f5b250-93c7-4efb-9bb8-d303dc63ef67 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:29.222359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-3b90668b-4d80-48e0-85e0-b4fe74ce1bb4 req-55f5b250-93c7-4efb-9bb8-d303dc63ef67 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:29.242337 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-3b90668b-4d80-48e0-85e0-b4fe74ce1bb4 req-55f5b250-93c7-4efb-9bb8-d303dc63ef67 service nova] Creating event network-changed:c45336db-0e36-4d75-8c9b-f63dc16532f1 for instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb on hv-cinder-84130 May 17 18:15:29.279469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-3b90668b-4d80-48e0-85e0-b4fe74ce1bb4 req-55f5b250-93c7-4efb-9bb8-d303dc63ef67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091932 May 17 18:15:29.280080 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 206/411] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:15:29.290739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f36f2394-c7d2-4da8-ba60-552ed65dec16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:29.293235 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f36f2394-c7d2-4da8-ba60-552ed65dec16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:29.308745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f36f2394-c7d2-4da8-ba60-552ed65dec16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:29.309500 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f36f2394-c7d2-4da8-ba60-552ed65dec16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:29.310510 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f36f2394-c7d2-4da8-ba60-552ed65dec16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:29.310982 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f36f2394-c7d2-4da8-ba60-552ed65dec16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:29.405942 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6d1a56b7-5868-49de-be48-9e5825a2c478 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:29.407052 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6d1a56b7-5868-49de-be48-9e5825a2c478 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:29.428775 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d1a56b7-5868-49de-be48-9e5825a2c478 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:29.429236 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d1a56b7-5868-49de-be48-9e5825a2c478 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:29.430028 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d1a56b7-5868-49de-be48-9e5825a2c478 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:29.430465 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d1a56b7-5868-49de-be48-9e5825a2c478 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:29.889383 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f36f2394-c7d2-4da8-ba60-552ed65dec16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:29.905842 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f36f2394-c7d2-4da8-ba60-552ed65dec16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:29.907394 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f36f2394-c7d2-4da8-ba60-552ed65dec16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:29.908567 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f36f2394-c7d2-4da8-ba60-552ed65dec16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.621693 May 17 18:15:29.919731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 206/412] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:29 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:29.933383 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3b1ace11-c1b8-4ae6-a596-fad04866f3bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:29.937421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3b1ace11-c1b8-4ae6-a596-fad04866f3bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:29.948191 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6d1a56b7-5868-49de-be48-9e5825a2c478 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:29.956413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6d1a56b7-5868-49de-be48-9e5825a2c478 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.554615 May 17 18:15:29.961054 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 207/413] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:29 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:29.963983 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3b1ace11-c1b8-4ae6-a596-fad04866f3bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:29.964864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3b1ace11-c1b8-4ae6-a596-fad04866f3bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:29.965896 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3b1ace11-c1b8-4ae6-a596-fad04866f3bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:29.966550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3b1ace11-c1b8-4ae6-a596-fad04866f3bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:29.995284 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5831e331-3983-4dad-9266-3ad4f1955cb8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:29.996894 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5831e331-3983-4dad-9266-3ad4f1955cb8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:30.020345 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5831e331-3983-4dad-9266-3ad4f1955cb8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:30.020829 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5831e331-3983-4dad-9266-3ad4f1955cb8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:30.021930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5831e331-3983-4dad-9266-3ad4f1955cb8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:30.022596 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5831e331-3983-4dad-9266-3ad4f1955cb8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:30.552518 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3b1ace11-c1b8-4ae6-a596-fad04866f3bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:30.561746 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3b1ace11-c1b8-4ae6-a596-fad04866f3bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.640621 May 17 18:15:30.562516 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 207/414] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:29 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:30.573104 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b63f7c4a-11e9-4487-af7b-a4705068e35f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Action: 'create', calling method: .version_select at 0x7f74abe938b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1511506757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcDS+AqpdL0ZzWQ8iS3zJBXzgdc7J1kajfeltwUuGvx4Gw4eGFWBElmXSH1qvCmMwHFN3Vtcwhv1VfWgXSjsUg43/rNC0CiK7mhw2huVVDTOwjKoysZymUAGJEJuHrCdQ=="}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:30.593311 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-b63f7c4a-11e9-4487-af7b-a4705068e35f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Getting quotas for project a0b25b97710c4115871b094e03709347. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:15:30.597449 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-b63f7c4a-11e9-4487-af7b-a4705068e35f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Getting quotas for user 759c9a68b8044d1a92b73f18c8f09d4d and project a0b25b97710c4115871b094e03709347. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:15:30.601561 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5831e331-3983-4dad-9266-3ad4f1955cb8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:30.619856 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5831e331-3983-4dad-9266-3ad4f1955cb8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.628531 May 17 18:15:30.632461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b63f7c4a-11e9-4487-af7b-a4705068e35f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.065435 May 17 18:15:30.633451 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 208/415] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 17 18:15:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:30.635104 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 208/416] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:29 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:30.783297 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1607698103", "imageRef": "19d35c68-262c-43a9-89fc-164a8d074b76", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1511506757", "networks": [{"uuid": "88fb0faa-74ba-4a8d-8238-a1e1532c6938"}]}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:30.909302 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] validate_networks() for [('88fb0faa-74ba-4a8d-8238-a1e1532c6938', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:15:30.933864 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6310ddae-3a46-41b5-89ef-77f00db0b5ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:30.934478 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6310ddae-3a46-41b5-89ef-77f00db0b5ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:30.942934 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6310ddae-3a46-41b5-89ef-77f00db0b5ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:30.945533 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6310ddae-3a46-41b5-89ef-77f00db0b5ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:30.946614 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6310ddae-3a46-41b5-89ef-77f00db0b5ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:30.947110 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6310ddae-3a46-41b5-89ef-77f00db0b5ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:31.269022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6310ddae-3a46-41b5-89ef-77f00db0b5ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:31.278542 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6310ddae-3a46-41b5-89ef-77f00db0b5ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:31.280082 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6310ddae-3a46-41b5-89ef-77f00db0b5ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:31.286247 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6310ddae-3a46-41b5-89ef-77f00db0b5ca tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.357529 May 17 18:15:31.289918 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 209/417] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:30 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:31.304707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5f86fe47-c50e-4fec-859e-ab8ed86d4283 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:31.305335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5f86fe47-c50e-4fec-859e-ab8ed86d4283 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:31.332574 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f86fe47-c50e-4fec-859e-ab8ed86d4283 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:31.334175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f86fe47-c50e-4fec-859e-ab8ed86d4283 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:31.336496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f86fe47-c50e-4fec-859e-ab8ed86d4283 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:31.337141 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f86fe47-c50e-4fec-859e-ab8ed86d4283 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:31.628133 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5f86fe47-c50e-4fec-859e-ab8ed86d4283 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:31.647719 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:15:31.648302 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5f86fe47-c50e-4fec-859e-ab8ed86d4283 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.354043 May 17 18:15:31.648551 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 210/418] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:31 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:31.653824 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-6c3f5027-33fc-43d1-9fbf-94d4b92a2015 req-293eef62-9b20-4153-9644-4b0ec590bcea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6933d9-d646-4718-9297-741290e08790", "tag": "b5450332-d4eb-4a0d-8ea4-c788c95e97e0"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:31.658504 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:15:31.659321 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:15:31.659999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:15:31.660646 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:15:31.665545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-6c3f5027-33fc-43d1-9fbf-94d4b92a2015 req-293eef62-9b20-4153-9644-4b0ec590bcea service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:31.666027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-6c3f5027-33fc-43d1-9fbf-94d4b92a2015 req-293eef62-9b20-4153-9644-4b0ec590bcea service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:31.671801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:31.672596 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:31.673655 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:31.674346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:31.683595 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-6c3f5027-33fc-43d1-9fbf-94d4b92a2015 req-293eef62-9b20-4153-9644-4b0ec590bcea service nova] Creating event network-changed:b5450332-d4eb-4a0d-8ea4-c788c95e97e0 for instance 1a6933d9-d646-4718-9297-741290e08790 on hv-cinder-84130 May 17 18:15:31.689526 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-6c3f5027-33fc-43d1-9fbf-94d4b92a2015 req-293eef62-9b20-4153-9644-4b0ec590bcea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039534 May 17 18:15:31.690832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 211/419] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:31.699588 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a7692317-01c4-45d6-b05e-ca8fdc820070 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:31.700292 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a7692317-01c4-45d6-b05e-ca8fdc820070 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:31.701476 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Getting quotas for project a0b25b97710c4115871b094e03709347. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:15:31.706587 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Getting quotas for user 759c9a68b8044d1a92b73f18c8f09d4d and project a0b25b97710c4115871b094e03709347. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:15:31.708541 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a7692317-01c4-45d6-b05e-ca8fdc820070 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:31.709003 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a7692317-01c4-45d6-b05e-ca8fdc820070 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:31.709791 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a7692317-01c4-45d6-b05e-ca8fdc820070 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:31.710230 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a7692317-01c4-45d6-b05e-ca8fdc820070 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:31.723275 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:15:31.726759 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19d35c68-262c-43a9-89fc-164a8d074b76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:15:31.797215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4d14dfb4-59d6-4d0a-9831-5e0098d28962 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035630 May 17 18:15:31.799213 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 209/420] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 18:15:31.805208 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-45f856e3-a330-497f-b932-19e9986fa602 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:31.805824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-45f856e3-a330-497f-b932-19e9986fa602 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:31.814081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-45f856e3-a330-497f-b932-19e9986fa602 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:31.814864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-45f856e3-a330-497f-b932-19e9986fa602 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:31.816093 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-45f856e3-a330-497f-b932-19e9986fa602 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:31.816821 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-45f856e3-a330-497f-b932-19e9986fa602 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:31.935003 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a7692317-01c4-45d6-b05e-ca8fdc820070 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:31.960310 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a7692317-01c4-45d6-b05e-ca8fdc820070 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.257399 May 17 18:15:31.961623 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 212/421] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:31 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:31.979405 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-98d1aa55-f646-4628-bb3c-2efa04f7f162 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:31.981611 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-98d1aa55-f646-4628-bb3c-2efa04f7f162 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:32.076477 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-98d1aa55-f646-4628-bb3c-2efa04f7f162 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:32.078479 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-45f856e3-a330-497f-b932-19e9986fa602 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:32.094366 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-98d1aa55-f646-4628-bb3c-2efa04f7f162 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1259 microversion: 2.1 time: 0.129041 May 17 18:15:32.099993 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-45f856e3-a330-497f-b932-19e9986fa602 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.299057 May 17 18:15:32.100494 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 213/422] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:31 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1259 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:32.111368 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 210/423] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:31 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:32.309357 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c2a7570b-e4f5-42d4-a29b-d7a670328bc7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:32.309921 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c2a7570b-e4f5-42d4-a29b-d7a670328bc7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:32.317339 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2a7570b-e4f5-42d4-a29b-d7a670328bc7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:32.318203 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2a7570b-e4f5-42d4-a29b-d7a670328bc7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:32.319947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2a7570b-e4f5-42d4-a29b-d7a670328bc7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:32.320551 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2a7570b-e4f5-42d4-a29b-d7a670328bc7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:32.475429 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c2a7570b-e4f5-42d4-a29b-d7a670328bc7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:32.484810 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c2a7570b-e4f5-42d4-a29b-d7a670328bc7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:32.487517 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c2a7570b-e4f5-42d4-a29b-d7a670328bc7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:32.488829 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c2a7570b-e4f5-42d4-a29b-d7a670328bc7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.185069 May 17 18:15:32.491914 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 214/424] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:32 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:32.688237 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-037b75bb-2be5-4cd2-a748-5416ccda6c1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:32.691764 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-037b75bb-2be5-4cd2-a748-5416ccda6c1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:32.701943 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-037b75bb-2be5-4cd2-a748-5416ccda6c1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:32.702802 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-037b75bb-2be5-4cd2-a748-5416ccda6c1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:32.703888 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-037b75bb-2be5-4cd2-a748-5416ccda6c1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:32.704462 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-037b75bb-2be5-4cd2-a748-5416ccda6c1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:32.875393 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-037b75bb-2be5-4cd2-a748-5416ccda6c1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:32.884695 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-037b75bb-2be5-4cd2-a748-5416ccda6c1d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.219521 May 17 18:15:32.886874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 211/425] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:32 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:32.897502 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-b385d639-b39f-4bf8-ba59-47921462ef51 req-20eb1ab4-0c01-4249-bd8b-4fb2be011ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769abf30-807c-41f0-bd94-0809137c0155", "name": "network-vif-plugged", "status": "completed", "tag": "cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:32.907354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-b385d639-b39f-4bf8-ba59-47921462ef51 req-20eb1ab4-0c01-4249-bd8b-4fb2be011ddc service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:32.908053 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-b385d639-b39f-4bf8-ba59-47921462ef51 req-20eb1ab4-0c01-4249-bd8b-4fb2be011ddc service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:32.927810 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-b385d639-b39f-4bf8-ba59-47921462ef51 req-20eb1ab4-0c01-4249-bd8b-4fb2be011ddc service nova] Creating event network-vif-plugged:cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb for instance 769abf30-807c-41f0-bd94-0809137c0155 on hv-cinder-84130 May 17 18:15:32.933522 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-b385d639-b39f-4bf8-ba59-47921462ef51 req-20eb1ab4-0c01-4249-bd8b-4fb2be011ddc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040739 May 17 18:15:32.934772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 215/426] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:15:32.977197 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ac48edf5-ac8f-40a9-8760-badb07e8e236 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:32.977815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ac48edf5-ac8f-40a9-8760-badb07e8e236 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:32.986100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ac48edf5-ac8f-40a9-8760-badb07e8e236 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:32.986564 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ac48edf5-ac8f-40a9-8760-badb07e8e236 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:32.987375 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ac48edf5-ac8f-40a9-8760-badb07e8e236 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:32.987820 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ac48edf5-ac8f-40a9-8760-badb07e8e236 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:33.114385 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c2b65305-01ca-4f80-b29a-4fd6b1d80fdc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:33.115130 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c2b65305-01ca-4f80-b29a-4fd6b1d80fdc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:33.125732 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2b65305-01ca-4f80-b29a-4fd6b1d80fdc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:33.126185 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2b65305-01ca-4f80-b29a-4fd6b1d80fdc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:33.127002 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2b65305-01ca-4f80-b29a-4fd6b1d80fdc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:33.127446 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c2b65305-01ca-4f80-b29a-4fd6b1d80fdc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:33.133228 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ac48edf5-ac8f-40a9-8760-badb07e8e236 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:33.142218 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ac48edf5-ac8f-40a9-8760-badb07e8e236 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.168797 May 17 18:15:33.152649 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 212/427] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:32 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:33.161101 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a8cfbe36-0732-4d78-9f66-f313a662c0e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:33.161723 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a8cfbe36-0732-4d78-9f66-f313a662c0e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:33.179211 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8cfbe36-0732-4d78-9f66-f313a662c0e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:33.181419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8cfbe36-0732-4d78-9f66-f313a662c0e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:33.183856 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8cfbe36-0732-4d78-9f66-f313a662c0e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:33.184578 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8cfbe36-0732-4d78-9f66-f313a662c0e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:33.213815 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c2b65305-01ca-4f80-b29a-4fd6b1d80fdc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:33.225180 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c2b65305-01ca-4f80-b29a-4fd6b1d80fdc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1263 microversion: 2.1 time: 0.117202 May 17 18:15:33.225922 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 216/428] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:33 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1263 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:33.335295 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a8cfbe36-0732-4d78-9f66-f313a662c0e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:33.344437 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a8cfbe36-0732-4d78-9f66-f313a662c0e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.187108 May 17 18:15:33.345295 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 213/429] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:33 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:33.508793 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-70279391-d054-479a-8af8-1e6e24cfd1de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:33.509393 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-70279391-d054-479a-8af8-1e6e24cfd1de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:33.519663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-70279391-d054-479a-8af8-1e6e24cfd1de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:33.520580 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-70279391-d054-479a-8af8-1e6e24cfd1de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:33.521801 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-70279391-d054-479a-8af8-1e6e24cfd1de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:33.522764 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-70279391-d054-479a-8af8-1e6e24cfd1de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:33.675350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-70279391-d054-479a-8af8-1e6e24cfd1de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:33.683361 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-70279391-d054-479a-8af8-1e6e24cfd1de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:33.684905 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-70279391-d054-479a-8af8-1e6e24cfd1de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:33.686339 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-70279391-d054-479a-8af8-1e6e24cfd1de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.181433 May 17 18:15:33.697301 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 217/430] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:33 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:33.904572 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c74f6e49-a3d3-46a1-9e6e-b68cb63ae786 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:33.905157 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c74f6e49-a3d3-46a1-9e6e-b68cb63ae786 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:33.911735 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c74f6e49-a3d3-46a1-9e6e-b68cb63ae786 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:33.912194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c74f6e49-a3d3-46a1-9e6e-b68cb63ae786 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:33.912973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c74f6e49-a3d3-46a1-9e6e-b68cb63ae786 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:33.913412 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c74f6e49-a3d3-46a1-9e6e-b68cb63ae786 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:34.068649 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c74f6e49-a3d3-46a1-9e6e-b68cb63ae786 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:34.076808 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c74f6e49-a3d3-46a1-9e6e-b68cb63ae786 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.176962 May 17 18:15:34.078387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 214/431] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:33 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:34.160311 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-2cc49715-5ab3-4636-9370-fe6ec50d8c2f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:34.160870 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-2cc49715-5ab3-4636-9370-fe6ec50d8c2f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:34.167143 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2cc49715-5ab3-4636-9370-fe6ec50d8c2f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:34.167811 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2cc49715-5ab3-4636-9370-fe6ec50d8c2f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:34.168951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2cc49715-5ab3-4636-9370-fe6ec50d8c2f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:34.169401 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2cc49715-5ab3-4636-9370-fe6ec50d8c2f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:34.243030 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3bb3278a-d333-454b-a102-db2889de192f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:34.243976 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3bb3278a-d333-454b-a102-db2889de192f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:34.252445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3bb3278a-d333-454b-a102-db2889de192f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:34.252908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3bb3278a-d333-454b-a102-db2889de192f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:34.253704 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3bb3278a-d333-454b-a102-db2889de192f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:34.254150 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3bb3278a-d333-454b-a102-db2889de192f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:34.351456 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3bb3278a-d333-454b-a102-db2889de192f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:34.363464 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3bb3278a-d333-454b-a102-db2889de192f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1263 microversion: 2.1 time: 0.124241 May 17 18:15:34.364233 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-2cc49715-5ab3-4636-9370-fe6ec50d8c2f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:34.367930 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 215/432] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:34 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1263 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:34.372278 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-2cc49715-5ab3-4636-9370-fe6ec50d8c2f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.216136 May 17 18:15:34.373477 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 218/433] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:34 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:34.379002 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ee763d50-5be6-49f4-8337-39ddc51db1b8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:34.379713 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ee763d50-5be6-49f4-8337-39ddc51db1b8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:34.388046 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ee763d50-5be6-49f4-8337-39ddc51db1b8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:34.388740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ee763d50-5be6-49f4-8337-39ddc51db1b8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:34.389474 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ee763d50-5be6-49f4-8337-39ddc51db1b8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:34.390015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ee763d50-5be6-49f4-8337-39ddc51db1b8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:34.542702 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ee763d50-5be6-49f4-8337-39ddc51db1b8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:34.551296 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ee763d50-5be6-49f4-8337-39ddc51db1b8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.182446 May 17 18:15:34.554615 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 216/434] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:34 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:34.705309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-112e547a-0f18-4f1a-a2e1-cc10f7434bb1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:34.706036 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-112e547a-0f18-4f1a-a2e1-cc10f7434bb1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:34.713090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-112e547a-0f18-4f1a-a2e1-cc10f7434bb1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:34.714010 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-112e547a-0f18-4f1a-a2e1-cc10f7434bb1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:34.715025 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-112e547a-0f18-4f1a-a2e1-cc10f7434bb1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:34.715535 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-112e547a-0f18-4f1a-a2e1-cc10f7434bb1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:34.861960 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-112e547a-0f18-4f1a-a2e1-cc10f7434bb1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:34.871983 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-112e547a-0f18-4f1a-a2e1-cc10f7434bb1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:34.873771 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-112e547a-0f18-4f1a-a2e1-cc10f7434bb1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:34.874961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-112e547a-0f18-4f1a-a2e1-cc10f7434bb1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.173583 May 17 18:15:34.875694 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 219/435] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:34 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:35.095930 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6cd9a617-e77e-4c58-953d-c5aed2416c4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:35.096578 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6cd9a617-e77e-4c58-953d-c5aed2416c4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:35.103367 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6cd9a617-e77e-4c58-953d-c5aed2416c4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:35.105309 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6cd9a617-e77e-4c58-953d-c5aed2416c4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:35.106178 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6cd9a617-e77e-4c58-953d-c5aed2416c4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:35.106731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6cd9a617-e77e-4c58-953d-c5aed2416c4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:35.259300 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6cd9a617-e77e-4c58-953d-c5aed2416c4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:35.269360 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6cd9a617-e77e-4c58-953d-c5aed2416c4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.177409 May 17 18:15:35.277758 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 217/436] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:35 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:35.379777 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7186af85-7ce6-4f81-868f-df4b5d66da4f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:35.380587 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7186af85-7ce6-4f81-868f-df4b5d66da4f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:35.388457 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7186af85-7ce6-4f81-868f-df4b5d66da4f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:35.389125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-76444f48-64f7-4d68-a22e-3256f407987a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:35.389466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7186af85-7ce6-4f81-868f-df4b5d66da4f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:35.389877 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-76444f48-64f7-4d68-a22e-3256f407987a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:35.390856 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7186af85-7ce6-4f81-868f-df4b5d66da4f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:35.391875 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7186af85-7ce6-4f81-868f-df4b5d66da4f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:35.398244 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76444f48-64f7-4d68-a22e-3256f407987a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:35.398757 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76444f48-64f7-4d68-a22e-3256f407987a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:35.399564 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76444f48-64f7-4d68-a22e-3256f407987a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:35.400003 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-76444f48-64f7-4d68-a22e-3256f407987a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:35.472895 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7186af85-7ce6-4f81-868f-df4b5d66da4f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:35.481495 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7186af85-7ce6-4f81-868f-df4b5d66da4f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1263 microversion: 2.1 time: 0.105347 May 17 18:15:35.482291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 220/437] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:35 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1263 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:35.578633 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-76444f48-64f7-4d68-a22e-3256f407987a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:35.579468 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6a025992-9cab-4550-982d-844d610adad7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:35.579468 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6a025992-9cab-4550-982d-844d610adad7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:35.587095 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6a025992-9cab-4550-982d-844d610adad7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:35.587572 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6a025992-9cab-4550-982d-844d610adad7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:35.588580 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6a025992-9cab-4550-982d-844d610adad7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:35.588943 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-76444f48-64f7-4d68-a22e-3256f407987a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.202313 May 17 18:15:35.589118 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6a025992-9cab-4550-982d-844d610adad7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:35.590371 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 218/438] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:35 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:35.788617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6a025992-9cab-4550-982d-844d610adad7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:35.797781 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6a025992-9cab-4550-982d-844d610adad7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1726 microversion: 2.1 time: 0.229298 May 17 18:15:35.798375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 221/439] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:35 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1726 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:35.894848 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9044ec6d-6513-49a8-8ad3-8ede92427d5f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:35.895769 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9044ec6d-6513-49a8-8ad3-8ede92427d5f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:35.906149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9044ec6d-6513-49a8-8ad3-8ede92427d5f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:35.907970 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9044ec6d-6513-49a8-8ad3-8ede92427d5f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:35.908803 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9044ec6d-6513-49a8-8ad3-8ede92427d5f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:35.909250 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9044ec6d-6513-49a8-8ad3-8ede92427d5f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:36.141085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9044ec6d-6513-49a8-8ad3-8ede92427d5f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:36.153630 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9044ec6d-6513-49a8-8ad3-8ede92427d5f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:36.155324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9044ec6d-6513-49a8-8ad3-8ede92427d5f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:36.156604 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9044ec6d-6513-49a8-8ad3-8ede92427d5f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.266311 May 17 18:15:36.157265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 219/440] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:35 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:36.287139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-82cf5b68-2251-4d50-b551-9ba8e82e4a71 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:36.288139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-82cf5b68-2251-4d50-b551-9ba8e82e4a71 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:36.294946 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82cf5b68-2251-4d50-b551-9ba8e82e4a71 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:36.295392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82cf5b68-2251-4d50-b551-9ba8e82e4a71 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:36.296366 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82cf5b68-2251-4d50-b551-9ba8e82e4a71 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:36.296800 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82cf5b68-2251-4d50-b551-9ba8e82e4a71 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:36.501182 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9dcbb07d-0634-4812-beaa-e2af1756207d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:36.502052 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9dcbb07d-0634-4812-beaa-e2af1756207d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:36.529245 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9dcbb07d-0634-4812-beaa-e2af1756207d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:36.536953 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9dcbb07d-0634-4812-beaa-e2af1756207d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:36.539681 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9dcbb07d-0634-4812-beaa-e2af1756207d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:36.542175 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9dcbb07d-0634-4812-beaa-e2af1756207d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:36.549982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-82cf5b68-2251-4d50-b551-9ba8e82e4a71 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:36.564734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-82cf5b68-2251-4d50-b551-9ba8e82e4a71 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.277859 May 17 18:15:36.566004 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 222/441] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:36 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:36.624684 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c36a75a8-733e-4656-a833-fa172ffd8ce3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:36.625867 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c36a75a8-733e-4656-a833-fa172ffd8ce3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:36.637457 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9dcbb07d-0634-4812-beaa-e2af1756207d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:36.646116 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c36a75a8-733e-4656-a833-fa172ffd8ce3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:36.646593 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c36a75a8-733e-4656-a833-fa172ffd8ce3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:36.646854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9dcbb07d-0634-4812-beaa-e2af1756207d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1319 microversion: 2.1 time: 0.151019 May 17 18:15:36.647388 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c36a75a8-733e-4656-a833-fa172ffd8ce3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:36.647827 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c36a75a8-733e-4656-a833-fa172ffd8ce3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:36.657742 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 220/442] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:36 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:36.818365 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c5236d3b-b292-4111-9532-d40465437120 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:36.819343 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c5236d3b-b292-4111-9532-d40465437120 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:36.837041 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5236d3b-b292-4111-9532-d40465437120 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:36.839927 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5236d3b-b292-4111-9532-d40465437120 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:36.842632 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5236d3b-b292-4111-9532-d40465437120 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:36.844359 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5236d3b-b292-4111-9532-d40465437120 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:36.907333 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c36a75a8-733e-4656-a833-fa172ffd8ce3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:36.917912 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c36a75a8-733e-4656-a833-fa172ffd8ce3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.304068 May 17 18:15:36.927689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 223/443] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:36 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:36.975394 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-355563079", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "networks": [{"uuid": "471818a4-b0b9-4f07-beba-4aaed5602f34"}]}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:37.036330 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.network.neutron [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] validate_networks() for [('471818a4-b0b9-4f07-beba-4aaed5602f34', None, None, None, None, None)] {{(pid=117021) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:15:37.086227 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c5236d3b-b292-4111-9532-d40465437120 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:37.099693 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c5236d3b-b292-4111-9532-d40465437120 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1703 microversion: 2.1 time: 0.287707 May 17 18:15:37.100682 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 221/444] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:36 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1703 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:37.119629 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bbbec806-911e-439b-9381-b2bb5f7b0f57 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:37.128455 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bbbec806-911e-439b-9381-b2bb5f7b0f57 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.129723 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bbbec806-911e-439b-9381-b2bb5f7b0f57 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.197899 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-bbbec806-911e-439b-9381-b2bb5f7b0f57 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Going to try to start instance {{(pid=117020) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 18:15:37.251385 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-bbbec806-911e-439b-9381-b2bb5f7b0f57 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/action" status: 202 len: 0 microversion: 2.1 time: 0.136305 May 17 18:15:37.253396 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 222/445] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:15:37 2022] POST /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:15:37.261220 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0ebc3f61-148a-4be5-a565-bdbd65298b0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:37.262028 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0ebc3f61-148a-4be5-a565-bdbd65298b0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:37.283588 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0ebc3f61-148a-4be5-a565-bdbd65298b0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.284174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0ebc3f61-148a-4be5-a565-bdbd65298b0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.285014 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0ebc3f61-148a-4be5-a565-bdbd65298b0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.285452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0ebc3f61-148a-4be5-a565-bdbd65298b0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.573884 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Flavor limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:15:37.574377 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Image limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:15:37.574807 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Flavor pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:15:37.576962 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Image pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:15:37.577832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:15:37.581677 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0ebc3f61-148a-4be5-a565-bdbd65298b0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:37.591719 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0ebc3f61-148a-4be5-a565-bdbd65298b0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:37.593435 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0ebc3f61-148a-4be5-a565-bdbd65298b0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:37.594860 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.595558 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.595682 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0ebc3f61-148a-4be5-a565-bdbd65298b0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.340100 May 17 18:15:37.598012 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.599082 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.607711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 223/446] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:37 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:37.613570 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-68246d15-ca9c-49de-a1e1-f1939a11c52f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:37.614286 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-68246d15-ca9c-49de-a1e1-f1939a11c52f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:37.622166 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-68246d15-ca9c-49de-a1e1-f1939a11c52f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.622767 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-68246d15-ca9c-49de-a1e1-f1939a11c52f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.623561 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-68246d15-ca9c-49de-a1e1-f1939a11c52f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.624011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-68246d15-ca9c-49de-a1e1-f1939a11c52f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.632817 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Getting quotas for project 76d421fe5f96421db7d4eeedd205b462. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:15:37.640214 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Getting quotas for user fc7eae5aa3594459bea417a96aae7d8d and project 76d421fe5f96421db7d4eeedd205b462. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:15:37.655728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Going to run 1 instances... {{(pid=117021) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:15:37.660303 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:15:37.724456 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b0c566c1-a21d-495b-92ef-aafa00a4fbfc tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752968 May 17 18:15:37.731054 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 224/447] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:15:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:15:37.731320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-0cbff166-e24a-4db1-a582-ca0eb7394c3a req-5ec682e6-02a2-4da3-89cc-f6c651782b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6933d9-d646-4718-9297-741290e08790", "name": "network-vif-plugged", "status": "completed", "tag": "b5450332-d4eb-4a0d-8ea4-c788c95e97e0"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:37.740701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-0cbff166-e24a-4db1-a582-ca0eb7394c3a req-5ec682e6-02a2-4da3-89cc-f6c651782b28 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.742052 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-0cbff166-e24a-4db1-a582-ca0eb7394c3a req-5ec682e6-02a2-4da3-89cc-f6c651782b28 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.766243 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-0cbff166-e24a-4db1-a582-ca0eb7394c3a req-5ec682e6-02a2-4da3-89cc-f6c651782b28 service nova] Creating event network-vif-plugged:b5450332-d4eb-4a0d-8ea4-c788c95e97e0 for instance 1a6933d9-d646-4718-9297-741290e08790 on hv-cinder-84130 May 17 18:15:37.774671 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-0cbff166-e24a-4db1-a582-ca0eb7394c3a req-5ec682e6-02a2-4da3-89cc-f6c651782b28 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047662 May 17 18:15:37.776074 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 225/448] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:37.783320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8215153d-1c94-47c0-8137-11706b2156b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:37.783667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8215153d-1c94-47c0-8137-11706b2156b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:37.792224 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8215153d-1c94-47c0-8137-11706b2156b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.792701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8215153d-1c94-47c0-8137-11706b2156b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.793603 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8215153d-1c94-47c0-8137-11706b2156b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.794043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8215153d-1c94-47c0-8137-11706b2156b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.799497 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-68246d15-ca9c-49de-a1e1-f1939a11c52f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:37.811399 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-68246d15-ca9c-49de-a1e1-f1939a11c52f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.202279 May 17 18:15:37.824203 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 224/449] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:37 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:37.829074 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3dea038e-d9ae-43aa-96a4-30bbdf84a1a8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:37.829686 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3dea038e-d9ae-43aa-96a4-30bbdf84a1a8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:37.856130 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3dea038e-d9ae-43aa-96a4-30bbdf84a1a8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.856598 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3dea038e-d9ae-43aa-96a4-30bbdf84a1a8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:37.857501 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3dea038e-d9ae-43aa-96a4-30bbdf84a1a8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:37.857835 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3dea038e-d9ae-43aa-96a4-30bbdf84a1a8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:38.028392 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3dea038e-d9ae-43aa-96a4-30bbdf84a1a8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:38.036394 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3dea038e-d9ae-43aa-96a4-30bbdf84a1a8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1317 microversion: 2.1 time: 0.211045 May 17 18:15:38.046521 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 225/450] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:37 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:38.048615 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-788ab134-7267-4f0e-985c-6b3c3326b97a tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:38.049218 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-788ab134-7267-4f0e-985c-6b3c3326b97a tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:38.176455 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-788ab134-7267-4f0e-985c-6b3c3326b97a tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:38.187515 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-788ab134-7267-4f0e-985c-6b3c3326b97a tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1218 microversion: 2.1 time: 0.142700 May 17 18:15:38.200732 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 226/451] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:38 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:38.202394 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8215153d-1c94-47c0-8137-11706b2156b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:38.210134 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-37181a28-d686-4d50-b670-c87712490ad0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:38.210542 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8215153d-1c94-47c0-8137-11706b2156b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.433210 May 17 18:15:38.211158 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 226/452] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:37 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:38.222460 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-37181a28-d686-4d50-b670-c87712490ad0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:38.230855 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-37181a28-d686-4d50-b670-c87712490ad0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:38.231660 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-37181a28-d686-4d50-b670-c87712490ad0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:38.232690 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-37181a28-d686-4d50-b670-c87712490ad0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:38.233453 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-37181a28-d686-4d50-b670-c87712490ad0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:38.440350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-37181a28-d686-4d50-b670-c87712490ad0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:38.449834 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-37181a28-d686-4d50-b670-c87712490ad0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.246175 May 17 18:15:38.461247 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 227/453] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:38 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:38.615516 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-527eb1ff-a371-4d40-8ebd-e613c5d2ea78 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:38.616333 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-527eb1ff-a371-4d40-8ebd-e613c5d2ea78 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:38.634315 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-527eb1ff-a371-4d40-8ebd-e613c5d2ea78 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:38.637228 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-527eb1ff-a371-4d40-8ebd-e613c5d2ea78 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:38.641761 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-527eb1ff-a371-4d40-8ebd-e613c5d2ea78 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:38.643248 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-527eb1ff-a371-4d40-8ebd-e613c5d2ea78 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:38.832820 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2869394d-7ab5-4855-831a-413397b4526b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:38.833904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2869394d-7ab5-4855-831a-413397b4526b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:38.848105 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2869394d-7ab5-4855-831a-413397b4526b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:38.848692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2869394d-7ab5-4855-831a-413397b4526b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:38.850267 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2869394d-7ab5-4855-831a-413397b4526b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:38.850875 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2869394d-7ab5-4855-831a-413397b4526b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:38.928951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-527eb1ff-a371-4d40-8ebd-e613c5d2ea78 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:38.945025 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-527eb1ff-a371-4d40-8ebd-e613c5d2ea78 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:38.954259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-527eb1ff-a371-4d40-8ebd-e613c5d2ea78 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:38.955740 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-527eb1ff-a371-4d40-8ebd-e613c5d2ea78 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.345043 May 17 18:15:38.957267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 227/454] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:38 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:39.054852 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0e4f6273-c8fb-4b28-95a1-58aeb3197196 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:39.055391 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0e4f6273-c8fb-4b28-95a1-58aeb3197196 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:39.085440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e4f6273-c8fb-4b28-95a1-58aeb3197196 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:39.085901 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e4f6273-c8fb-4b28-95a1-58aeb3197196 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:39.086795 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e4f6273-c8fb-4b28-95a1-58aeb3197196 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:39.087242 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e4f6273-c8fb-4b28-95a1-58aeb3197196 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:39.268565 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2869394d-7ab5-4855-831a-413397b4526b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:39.277167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2869394d-7ab5-4855-831a-413397b4526b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.450576 May 17 18:15:39.283838 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 228/455] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:38 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:39.288739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1779c5f1-059e-4c5d-9532-694d307bf4ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:39.289351 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1779c5f1-059e-4c5d-9532-694d307bf4ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:39.308005 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0e4f6273-c8fb-4b28-95a1-58aeb3197196 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:39.318039 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1779c5f1-059e-4c5d-9532-694d307bf4ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:39.322925 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1779c5f1-059e-4c5d-9532-694d307bf4ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:39.323769 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1779c5f1-059e-4c5d-9532-694d307bf4ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:39.324214 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1779c5f1-059e-4c5d-9532-694d307bf4ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:39.325150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0e4f6273-c8fb-4b28-95a1-58aeb3197196 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1317 microversion: 2.1 time: 0.274562 May 17 18:15:39.325750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 228/456] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:39 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:39.350275 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8a33a5ad-b88e-4900-9d27-aa42e19003b5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:39.361220 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8a33a5ad-b88e-4900-9d27-aa42e19003b5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:39.418941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1779c5f1-059e-4c5d-9532-694d307bf4ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:39.421483 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1779c5f1-059e-4c5d-9532-694d307bf4ec tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1270 microversion: 2.1 time: 0.136357 May 17 18:15:39.422084 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 229/457] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:39 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:39.437499 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a33a5ad-b88e-4900-9d27-aa42e19003b5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:39.438623 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a33a5ad-b88e-4900-9d27-aa42e19003b5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:39.448556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a33a5ad-b88e-4900-9d27-aa42e19003b5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:39.449682 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a33a5ad-b88e-4900-9d27-aa42e19003b5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:39.469334 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-61a83ff2-f042-4c58-af96-2524033edec5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:39.470025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-61a83ff2-f042-4c58-af96-2524033edec5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:39.481048 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-61a83ff2-f042-4c58-af96-2524033edec5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:39.481501 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-61a83ff2-f042-4c58-af96-2524033edec5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:39.482419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-61a83ff2-f042-4c58-af96-2524033edec5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:39.483510 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-61a83ff2-f042-4c58-af96-2524033edec5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.047152 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-61a83ff2-f042-4c58-af96-2524033edec5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:40.053973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-61a83ff2-f042-4c58-af96-2524033edec5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.588797 May 17 18:15:40.054516 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 230/458] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:39 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:40.080394 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c3b003e7-6192-46bc-9426-f06c792ad4e9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:40.081330 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c3b003e7-6192-46bc-9426-f06c792ad4e9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:40.102909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c3b003e7-6192-46bc-9426-f06c792ad4e9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:40.104664 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8a33a5ad-b88e-4900-9d27-aa42e19003b5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:40.105441 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c3b003e7-6192-46bc-9426-f06c792ad4e9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.106437 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c3b003e7-6192-46bc-9426-f06c792ad4e9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:40.107078 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c3b003e7-6192-46bc-9426-f06c792ad4e9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.124676 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8a33a5ad-b88e-4900-9d27-aa42e19003b5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.780640 May 17 18:15:40.134343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 229/459] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:39 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:40.287248 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c3b003e7-6192-46bc-9426-f06c792ad4e9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:40.297313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c3b003e7-6192-46bc-9426-f06c792ad4e9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:40.299863 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-93e70338-c642-41eb-b65b-baa57d761283 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:40.300622 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c3b003e7-6192-46bc-9426-f06c792ad4e9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:40.302145 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c3b003e7-6192-46bc-9426-f06c792ad4e9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.242569 May 17 18:15:40.302279 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-93e70338-c642-41eb-b65b-baa57d761283 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:40.303001 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 231/460] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:40 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:40.321047 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93e70338-c642-41eb-b65b-baa57d761283 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:40.324852 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93e70338-c642-41eb-b65b-baa57d761283 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.327596 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93e70338-c642-41eb-b65b-baa57d761283 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:40.328542 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93e70338-c642-41eb-b65b-baa57d761283 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.343188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b35f2806-5bda-4fc9-b6c4-2b701174e663 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:40.343809 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b35f2806-5bda-4fc9-b6c4-2b701174e663 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:40.352288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b35f2806-5bda-4fc9-b6c4-2b701174e663 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:40.352987 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b35f2806-5bda-4fc9-b6c4-2b701174e663 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.354072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b35f2806-5bda-4fc9-b6c4-2b701174e663 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:40.354938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b35f2806-5bda-4fc9-b6c4-2b701174e663 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.671998 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b35f2806-5bda-4fc9-b6c4-2b701174e663 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:40.685842 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b35f2806-5bda-4fc9-b6c4-2b701174e663 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.346397 May 17 18:15:40.686733 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 232/461] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:40 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:40.692400 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-63e639cd-1f5e-4b88-820c-5f4a42804e44 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:40.693461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-63e639cd-1f5e-4b88-820c-5f4a42804e44 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:40.700744 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-63e639cd-1f5e-4b88-820c-5f4a42804e44 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:40.704568 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-63e639cd-1f5e-4b88-820c-5f4a42804e44 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.706811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-63e639cd-1f5e-4b88-820c-5f4a42804e44 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:40.707226 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-63e639cd-1f5e-4b88-820c-5f4a42804e44 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.723915 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-93e70338-c642-41eb-b65b-baa57d761283 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:40.735044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-93e70338-c642-41eb-b65b-baa57d761283 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.443532 May 17 18:15:40.748407 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 230/462] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:40 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:40.804641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-63e639cd-1f5e-4b88-820c-5f4a42804e44 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:40.835950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-63e639cd-1f5e-4b88-820c-5f4a42804e44 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1278 microversion: 2.1 time: 0.147665 May 17 18:15:40.836911 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 233/463] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:40 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:41.071887 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3f19cfe7-5277-49c6-a38c-77b7d8bfada5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:41.073735 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3f19cfe7-5277-49c6-a38c-77b7d8bfada5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:41.083867 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f19cfe7-5277-49c6-a38c-77b7d8bfada5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.084456 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f19cfe7-5277-49c6-a38c-77b7d8bfada5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.086054 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f19cfe7-5277-49c6-a38c-77b7d8bfada5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.087310 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f19cfe7-5277-49c6-a38c-77b7d8bfada5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.146036 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-482e4441-30f2-4cf2-b238-460726bab02a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:41.148555 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-482e4441-30f2-4cf2-b238-460726bab02a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:41.164403 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-482e4441-30f2-4cf2-b238-460726bab02a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.165311 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-482e4441-30f2-4cf2-b238-460726bab02a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.166808 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-482e4441-30f2-4cf2-b238-460726bab02a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.167264 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-482e4441-30f2-4cf2-b238-460726bab02a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.291716 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3f19cfe7-5277-49c6-a38c-77b7d8bfada5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:41.303097 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3f19cfe7-5277-49c6-a38c-77b7d8bfada5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.235231 May 17 18:15:41.303693 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 231/464] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:41 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:41.325269 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-89deb5e4-a703-42a1-a3bd-dfc3cf41745d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:41.326313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-89deb5e4-a703-42a1-a3bd-dfc3cf41745d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:41.334531 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-89deb5e4-a703-42a1-a3bd-dfc3cf41745d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.335021 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-89deb5e4-a703-42a1-a3bd-dfc3cf41745d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.335821 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-89deb5e4-a703-42a1-a3bd-dfc3cf41745d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.336371 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-89deb5e4-a703-42a1-a3bd-dfc3cf41745d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.369559 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-482e4441-30f2-4cf2-b238-460726bab02a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:41.377340 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-482e4441-30f2-4cf2-b238-460726bab02a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.239865 May 17 18:15:41.377914 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 234/465] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:41 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:41.488369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-89deb5e4-a703-42a1-a3bd-dfc3cf41745d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:41.500175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-89deb5e4-a703-42a1-a3bd-dfc3cf41745d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:41.503481 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-89deb5e4-a703-42a1-a3bd-dfc3cf41745d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:41.504830 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-89deb5e4-a703-42a1-a3bd-dfc3cf41745d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.187279 May 17 18:15:41.505473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 232/466] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:41 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:41.602866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-9003328d-eb41-4228-991e-81089c15ab49 req-502788e8-cacb-4009-9443-c1075e72b6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1966aa90-f5e3-4591-8105-69f6cc0fbdfb", "name": "network-vif-plugged", "status": "completed", "tag": "c45336db-0e36-4d75-8c9b-f63dc16532f1"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:41.611815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-9003328d-eb41-4228-991e-81089c15ab49 req-502788e8-cacb-4009-9443-c1075e72b6dc service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.612645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-9003328d-eb41-4228-991e-81089c15ab49 req-502788e8-cacb-4009-9443-c1075e72b6dc service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.625404 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-9003328d-eb41-4228-991e-81089c15ab49 req-502788e8-cacb-4009-9443-c1075e72b6dc service nova] Creating event network-vif-plugged:c45336db-0e36-4d75-8c9b-f63dc16532f1 for instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb on hv-cinder-84130 May 17 18:15:41.632522 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-9003328d-eb41-4228-991e-81089c15ab49 req-502788e8-cacb-4009-9443-c1075e72b6dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033462 May 17 18:15:41.633751 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 235/467] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:41.704365 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ccf5f920-b208-415b-85ff-3109314215a3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:41.705143 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ccf5f920-b208-415b-85ff-3109314215a3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:41.713319 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ccf5f920-b208-415b-85ff-3109314215a3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.713908 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ccf5f920-b208-415b-85ff-3109314215a3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.714881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ccf5f920-b208-415b-85ff-3109314215a3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.715426 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ccf5f920-b208-415b-85ff-3109314215a3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.753792 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-56e0f847-cff7-4864-b9e1-80d86d20f31b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:41.754485 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-56e0f847-cff7-4864-b9e1-80d86d20f31b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:41.761867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56e0f847-cff7-4864-b9e1-80d86d20f31b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.762831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56e0f847-cff7-4864-b9e1-80d86d20f31b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.764142 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56e0f847-cff7-4864-b9e1-80d86d20f31b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.764875 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56e0f847-cff7-4864-b9e1-80d86d20f31b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.911076 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ccf5f920-b208-415b-85ff-3109314215a3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:41.919690 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ccf5f920-b208-415b-85ff-3109314215a3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.219086 May 17 18:15:41.930507 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 233/468] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:41 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:41.936305 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9c595cbc-87af-4ac1-af31-f0bab9ec6c17 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:41.937188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9c595cbc-87af-4ac1-af31-f0bab9ec6c17 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:41.944233 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9c595cbc-87af-4ac1-af31-f0bab9ec6c17 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.944687 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9c595cbc-87af-4ac1-af31-f0bab9ec6c17 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.945474 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9c595cbc-87af-4ac1-af31-f0bab9ec6c17 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:41.945914 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9c595cbc-87af-4ac1-af31-f0bab9ec6c17 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:41.957641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-56e0f847-cff7-4864-b9e1-80d86d20f31b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:41.966483 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-56e0f847-cff7-4864-b9e1-80d86d20f31b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.216792 May 17 18:15:41.967098 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 236/469] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:41 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:42.012529 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9c595cbc-87af-4ac1-af31-f0bab9ec6c17 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:42.021370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9c595cbc-87af-4ac1-af31-f0bab9ec6c17 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1278 microversion: 2.1 time: 0.089162 May 17 18:15:42.030626 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 234/470] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:41 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:42.320107 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4d1dfb78-16bf-4b1f-864a-f5eed031fc20 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:42.320961 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4d1dfb78-16bf-4b1f-864a-f5eed031fc20 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:42.328881 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d1dfb78-16bf-4b1f-864a-f5eed031fc20 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.329337 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d1dfb78-16bf-4b1f-864a-f5eed031fc20 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.330119 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d1dfb78-16bf-4b1f-864a-f5eed031fc20 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.330558 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4d1dfb78-16bf-4b1f-864a-f5eed031fc20 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.395469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5675d84e-d5b9-4452-bc56-2834a42a3559 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:42.396062 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5675d84e-d5b9-4452-bc56-2834a42a3559 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:42.402523 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5675d84e-d5b9-4452-bc56-2834a42a3559 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.403000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5675d84e-d5b9-4452-bc56-2834a42a3559 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.403767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5675d84e-d5b9-4452-bc56-2834a42a3559 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.404205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5675d84e-d5b9-4452-bc56-2834a42a3559 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.510729 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4d1dfb78-16bf-4b1f-864a-f5eed031fc20 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:42.520679 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4d1dfb78-16bf-4b1f-864a-f5eed031fc20 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.204628 May 17 18:15:42.521354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 237/471] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:42 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:42.527801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0f6114ca-2b1e-44eb-9c5e-f691e9158c05 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:42.528427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0f6114ca-2b1e-44eb-9c5e-f691e9158c05 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:42.538746 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0f6114ca-2b1e-44eb-9c5e-f691e9158c05 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.539318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0f6114ca-2b1e-44eb-9c5e-f691e9158c05 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.540207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0f6114ca-2b1e-44eb-9c5e-f691e9158c05 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.541763 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0f6114ca-2b1e-44eb-9c5e-f691e9158c05 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.566700 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5675d84e-d5b9-4452-bc56-2834a42a3559 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:42.574820 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5675d84e-d5b9-4452-bc56-2834a42a3559 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.183098 May 17 18:15:42.575648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 235/472] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:42 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:42.701694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0f6114ca-2b1e-44eb-9c5e-f691e9158c05 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:42.711444 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0f6114ca-2b1e-44eb-9c5e-f691e9158c05 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:42.713577 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0f6114ca-2b1e-44eb-9c5e-f691e9158c05 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:42.714979 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0f6114ca-2b1e-44eb-9c5e-f691e9158c05 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.192470 May 17 18:15:42.715546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 238/473] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:42 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:42.935886 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-049ece3f-4d0b-419f-a7c4-f3ba9a4cc4fa tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:42.936489 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-049ece3f-4d0b-419f-a7c4-f3ba9a4cc4fa tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:42.942383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-049ece3f-4d0b-419f-a7c4-f3ba9a4cc4fa tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.943119 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-049ece3f-4d0b-419f-a7c4-f3ba9a4cc4fa tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.943876 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-049ece3f-4d0b-419f-a7c4-f3ba9a4cc4fa tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.944304 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-049ece3f-4d0b-419f-a7c4-f3ba9a4cc4fa tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.983628 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-89711080-40e8-48f7-9d49-5e54e59aaf47 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:42.984520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-89711080-40e8-48f7-9d49-5e54e59aaf47 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:42.991567 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-89711080-40e8-48f7-9d49-5e54e59aaf47 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.992297 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-89711080-40e8-48f7-9d49-5e54e59aaf47 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.993481 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-89711080-40e8-48f7-9d49-5e54e59aaf47 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.994296 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-89711080-40e8-48f7-9d49-5e54e59aaf47 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:43.174374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-049ece3f-4d0b-419f-a7c4-f3ba9a4cc4fa tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:43.182859 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-049ece3f-4d0b-419f-a7c4-f3ba9a4cc4fa tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.250664 May 17 18:15:43.192977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 236/474] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:42 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:43.198531 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9f957813-b880-443f-84dd-a837539b6fdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:43.199190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9f957813-b880-443f-84dd-a837539b6fdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:43.201066 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-89711080-40e8-48f7-9d49-5e54e59aaf47 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:43.205247 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9f957813-b880-443f-84dd-a837539b6fdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:43.205718 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9f957813-b880-443f-84dd-a837539b6fdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:43.206485 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9f957813-b880-443f-84dd-a837539b6fdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:43.206958 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9f957813-b880-443f-84dd-a837539b6fdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:43.215543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-89711080-40e8-48f7-9d49-5e54e59aaf47 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.235544 May 17 18:15:43.216420 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 239/475] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:42 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:43.280087 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9f957813-b880-443f-84dd-a837539b6fdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:43.287629 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9f957813-b880-443f-84dd-a837539b6fdb tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1278 microversion: 2.1 time: 0.093542 May 17 18:15:43.288402 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 237/476] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:43 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:43.537380 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-07a9c973-31eb-4fcf-8fb2-e7dd6e72d3d4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:43.538272 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-07a9c973-31eb-4fcf-8fb2-e7dd6e72d3d4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:43.545551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-07a9c973-31eb-4fcf-8fb2-e7dd6e72d3d4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:43.546013 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-07a9c973-31eb-4fcf-8fb2-e7dd6e72d3d4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:43.546824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-07a9c973-31eb-4fcf-8fb2-e7dd6e72d3d4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:43.547269 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-07a9c973-31eb-4fcf-8fb2-e7dd6e72d3d4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:43.592366 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e75cdae9-56b7-4c53-81d3-f932f2e2c933 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:43.593386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e75cdae9-56b7-4c53-81d3-f932f2e2c933 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:43.600054 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e75cdae9-56b7-4c53-81d3-f932f2e2c933 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:43.600508 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e75cdae9-56b7-4c53-81d3-f932f2e2c933 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:43.601415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e75cdae9-56b7-4c53-81d3-f932f2e2c933 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:43.601858 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e75cdae9-56b7-4c53-81d3-f932f2e2c933 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:43.767447 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-07a9c973-31eb-4fcf-8fb2-e7dd6e72d3d4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:43.774781 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-07a9c973-31eb-4fcf-8fb2-e7dd6e72d3d4 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.241318 May 17 18:15:43.775389 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 240/477] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:43 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:43.779976 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4c560a24-7623-428c-ab53-ede3fefdc188 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:43.780588 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4c560a24-7623-428c-ab53-ede3fefdc188 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:43.789975 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4c560a24-7623-428c-ab53-ede3fefdc188 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:43.790353 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4c560a24-7623-428c-ab53-ede3fefdc188 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:43.791710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4c560a24-7623-428c-ab53-ede3fefdc188 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:43.792157 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4c560a24-7623-428c-ab53-ede3fefdc188 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:43.812795 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e75cdae9-56b7-4c53-81d3-f932f2e2c933 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:43.820838 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e75cdae9-56b7-4c53-81d3-f932f2e2c933 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.232731 May 17 18:15:43.821916 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 238/478] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:43 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:43.944104 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4c560a24-7623-428c-ab53-ede3fefdc188 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:43.952699 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4c560a24-7623-428c-ab53-ede3fefdc188 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:43.954182 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4c560a24-7623-428c-ab53-ede3fefdc188 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:43.955437 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4c560a24-7623-428c-ab53-ede3fefdc188 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.179119 May 17 18:15:43.955996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 241/479] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:43 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:44.201309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-2f844686-3e61-4cf1-bd15-f540cd044e2b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:44.202120 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-2f844686-3e61-4cf1-bd15-f540cd044e2b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:44.209372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2f844686-3e61-4cf1-bd15-f540cd044e2b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:44.209822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2f844686-3e61-4cf1-bd15-f540cd044e2b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:44.210819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2f844686-3e61-4cf1-bd15-f540cd044e2b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:44.211434 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2f844686-3e61-4cf1-bd15-f540cd044e2b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:44.233944 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c8e41275-2265-4429-9706-e8edf2d24b12 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:44.234539 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c8e41275-2265-4429-9706-e8edf2d24b12 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:44.243272 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c8e41275-2265-4429-9706-e8edf2d24b12 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:44.243752 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c8e41275-2265-4429-9706-e8edf2d24b12 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:44.245224 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c8e41275-2265-4429-9706-e8edf2d24b12 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:44.245622 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c8e41275-2265-4429-9706-e8edf2d24b12 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:44.432637 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c8e41275-2265-4429-9706-e8edf2d24b12 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:44.435495 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-2f844686-3e61-4cf1-bd15-f540cd044e2b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:44.441558 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c8e41275-2265-4429-9706-e8edf2d24b12 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.211508 May 17 18:15:44.446019 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-2f844686-3e61-4cf1-bd15-f540cd044e2b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.246474 May 17 18:15:44.446218 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 242/480] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:44 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:44.449465 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3f7e9847-933c-48d6-b515-2040b9cff434 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:44.450082 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3f7e9847-933c-48d6-b515-2040b9cff434 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:44.453738 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 239/481] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:44 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:44.456244 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f7e9847-933c-48d6-b515-2040b9cff434 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:44.456688 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f7e9847-933c-48d6-b515-2040b9cff434 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:44.457455 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f7e9847-933c-48d6-b515-2040b9cff434 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:44.457888 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f7e9847-933c-48d6-b515-2040b9cff434 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:44.526151 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3f7e9847-933c-48d6-b515-2040b9cff434 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:44.534891 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3f7e9847-933c-48d6-b515-2040b9cff434 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1278 microversion: 2.1 time: 0.090436 May 17 18:15:44.535764 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 243/482] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:44 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:44.794014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-368adde0-6e00-4df5-a882-de5637b72a49 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:44.794643 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-368adde0-6e00-4df5-a882-de5637b72a49 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:44.800998 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-368adde0-6e00-4df5-a882-de5637b72a49 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:44.801545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-368adde0-6e00-4df5-a882-de5637b72a49 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:44.802626 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-368adde0-6e00-4df5-a882-de5637b72a49 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:44.803297 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-368adde0-6e00-4df5-a882-de5637b72a49 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:44.838397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-08b46ed3-5f2f-4320-a098-3302909a3c93 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:44.839443 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-08b46ed3-5f2f-4320-a098-3302909a3c93 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:44.847024 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-08b46ed3-5f2f-4320-a098-3302909a3c93 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:44.847478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-08b46ed3-5f2f-4320-a098-3302909a3c93 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:44.848257 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-08b46ed3-5f2f-4320-a098-3302909a3c93 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:44.848694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-08b46ed3-5f2f-4320-a098-3302909a3c93 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:45.001745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-368adde0-6e00-4df5-a882-de5637b72a49 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:45.009017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-368adde0-6e00-4df5-a882-de5637b72a49 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.219568 May 17 18:15:45.009943 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 240/483] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:44 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:45.015115 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6cda4ada-66d7-4b4d-b7ae-2371c5cc8029 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:45.015726 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6cda4ada-66d7-4b4d-b7ae-2371c5cc8029 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:45.021998 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6cda4ada-66d7-4b4d-b7ae-2371c5cc8029 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:45.022455 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6cda4ada-66d7-4b4d-b7ae-2371c5cc8029 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:45.023267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6cda4ada-66d7-4b4d-b7ae-2371c5cc8029 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:45.023709 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6cda4ada-66d7-4b4d-b7ae-2371c5cc8029 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:45.028181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-08b46ed3-5f2f-4320-a098-3302909a3c93 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:45.035732 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-08b46ed3-5f2f-4320-a098-3302909a3c93 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.202004 May 17 18:15:45.046546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 244/484] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:44 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:45.180135 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6cda4ada-66d7-4b4d-b7ae-2371c5cc8029 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:45.189915 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6cda4ada-66d7-4b4d-b7ae-2371c5cc8029 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:45.191658 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6cda4ada-66d7-4b4d-b7ae-2371c5cc8029 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:45.193588 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6cda4ada-66d7-4b4d-b7ae-2371c5cc8029 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.182829 May 17 18:15:45.194217 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 241/485] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:45 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:45.460740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1f9c08ef-e571-4fdc-8b3c-6c3dbe72f593 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:45.461028 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-676f8c9a-4109-4452-9a62-5cb024d58947 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:45.461546 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-676f8c9a-4109-4452-9a62-5cb024d58947 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:45.462161 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1f9c08ef-e571-4fdc-8b3c-6c3dbe72f593 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:45.468876 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-676f8c9a-4109-4452-9a62-5cb024d58947 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:45.469345 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-676f8c9a-4109-4452-9a62-5cb024d58947 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:45.470131 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-676f8c9a-4109-4452-9a62-5cb024d58947 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:45.470586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-676f8c9a-4109-4452-9a62-5cb024d58947 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:45.471454 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1f9c08ef-e571-4fdc-8b3c-6c3dbe72f593 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:45.472131 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1f9c08ef-e571-4fdc-8b3c-6c3dbe72f593 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:45.473597 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1f9c08ef-e571-4fdc-8b3c-6c3dbe72f593 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:45.475893 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1f9c08ef-e571-4fdc-8b3c-6c3dbe72f593 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:45.678864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1f9c08ef-e571-4fdc-8b3c-6c3dbe72f593 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:45.682137 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-676f8c9a-4109-4452-9a62-5cb024d58947 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:45.687067 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1f9c08ef-e571-4fdc-8b3c-6c3dbe72f593 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.230384 May 17 18:15:45.687731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 245/486] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:45 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:45.692273 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ea23ce5f-2162-40e8-8623-71ba46903baf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:45.693146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ea23ce5f-2162-40e8-8623-71ba46903baf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:45.699085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ea23ce5f-2162-40e8-8623-71ba46903baf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:45.699547 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ea23ce5f-2162-40e8-8623-71ba46903baf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:45.700349 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ea23ce5f-2162-40e8-8623-71ba46903baf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:45.700779 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ea23ce5f-2162-40e8-8623-71ba46903baf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:45.714038 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-676f8c9a-4109-4452-9a62-5cb024d58947 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.256489 May 17 18:15:45.730615 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 242/487] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:45 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:45.775849 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ea23ce5f-2162-40e8-8623-71ba46903baf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:45.783439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ea23ce5f-2162-40e8-8623-71ba46903baf tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1278 microversion: 2.1 time: 0.094633 May 17 18:15:45.784025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 246/488] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:45 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:46.028404 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6448c94e-c4d3-40e8-b71c-a45d9213df54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:46.029005 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6448c94e-c4d3-40e8-b71c-a45d9213df54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:46.035573 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6448c94e-c4d3-40e8-b71c-a45d9213df54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.036030 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6448c94e-c4d3-40e8-b71c-a45d9213df54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.036807 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6448c94e-c4d3-40e8-b71c-a45d9213df54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.037249 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6448c94e-c4d3-40e8-b71c-a45d9213df54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.062606 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0caa5616-b848-45ff-b2d0-dc42a0573673 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:46.062606 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0caa5616-b848-45ff-b2d0-dc42a0573673 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:46.063288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0caa5616-b848-45ff-b2d0-dc42a0573673 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.063288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0caa5616-b848-45ff-b2d0-dc42a0573673 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.064114 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0caa5616-b848-45ff-b2d0-dc42a0573673 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.064548 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0caa5616-b848-45ff-b2d0-dc42a0573673 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.467926 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6448c94e-c4d3-40e8-b71c-a45d9213df54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:46.479387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0caa5616-b848-45ff-b2d0-dc42a0573673 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:46.486745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0caa5616-b848-45ff-b2d0-dc42a0573673 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.437304 May 17 18:15:46.489043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6448c94e-c4d3-40e8-b71c-a45d9213df54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.465006 May 17 18:15:46.501016 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 243/490] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:46 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:46.501463 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 247/490] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:46 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:46.506518 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-26512615-2d43-44b5-b164-c16156146f4a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:46.507159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-26512615-2d43-44b5-b164-c16156146f4a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:46.514362 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-26512615-2d43-44b5-b164-c16156146f4a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.514859 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-26512615-2d43-44b5-b164-c16156146f4a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.515634 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-26512615-2d43-44b5-b164-c16156146f4a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.516075 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-26512615-2d43-44b5-b164-c16156146f4a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.646807 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-26512615-2d43-44b5-b164-c16156146f4a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:46.656522 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-26512615-2d43-44b5-b164-c16156146f4a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:46.658006 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-26512615-2d43-44b5-b164-c16156146f4a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:46.659305 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-26512615-2d43-44b5-b164-c16156146f4a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.157099 May 17 18:15:46.670396 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 244/491] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:46 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:46.704623 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f34d450e-6cad-47ce-b6ac-6615caa60ba7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:46.705226 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f34d450e-6cad-47ce-b6ac-6615caa60ba7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:46.711427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f34d450e-6cad-47ce-b6ac-6615caa60ba7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.711890 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f34d450e-6cad-47ce-b6ac-6615caa60ba7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.712707 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f34d450e-6cad-47ce-b6ac-6615caa60ba7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.713150 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f34d450e-6cad-47ce-b6ac-6615caa60ba7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.739598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0d20c737-f8d0-44da-bcf0-5ea40b21759a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:46.740116 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0d20c737-f8d0-44da-bcf0-5ea40b21759a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:46.746706 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d20c737-f8d0-44da-bcf0-5ea40b21759a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.747207 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d20c737-f8d0-44da-bcf0-5ea40b21759a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.747970 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d20c737-f8d0-44da-bcf0-5ea40b21759a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.748374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0d20c737-f8d0-44da-bcf0-5ea40b21759a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.951302 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f34d450e-6cad-47ce-b6ac-6615caa60ba7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:46.961400 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f34d450e-6cad-47ce-b6ac-6615caa60ba7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.260618 May 17 18:15:46.961988 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 248/492] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:46 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:46.969053 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0d20c737-f8d0-44da-bcf0-5ea40b21759a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:46.972492 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-92f1394a-d0fa-4665-ab77-4c6df3627347 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:46.973127 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-92f1394a-d0fa-4665-ab77-4c6df3627347 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:46.976930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0d20c737-f8d0-44da-bcf0-5ea40b21759a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.241126 May 17 18:15:46.977694 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 245/493] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:46 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:46.979857 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-92f1394a-d0fa-4665-ab77-4c6df3627347 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.980317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-92f1394a-d0fa-4665-ab77-4c6df3627347 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:46.981102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-92f1394a-d0fa-4665-ab77-4c6df3627347 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:46.981541 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-92f1394a-d0fa-4665-ab77-4c6df3627347 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:47.043977 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-92f1394a-d0fa-4665-ab77-4c6df3627347 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:47.051848 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-92f1394a-d0fa-4665-ab77-4c6df3627347 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1278 microversion: 2.1 time: 0.088355 May 17 18:15:47.052406 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 249/494] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:46 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:47.507778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e75911d1-1282-49a9-bde6-913dd0eaa930 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:47.508422 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e75911d1-1282-49a9-bde6-913dd0eaa930 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:47.515768 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e75911d1-1282-49a9-bde6-913dd0eaa930 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:47.516214 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e75911d1-1282-49a9-bde6-913dd0eaa930 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:47.516979 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e75911d1-1282-49a9-bde6-913dd0eaa930 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:47.517411 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e75911d1-1282-49a9-bde6-913dd0eaa930 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:47.518872 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-cbfcbcfb-6400-41d4-8ec0-4dba2c5e4d79 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:47.519562 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-cbfcbcfb-6400-41d4-8ec0-4dba2c5e4d79 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:47.526882 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cbfcbcfb-6400-41d4-8ec0-4dba2c5e4d79 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:47.527418 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cbfcbcfb-6400-41d4-8ec0-4dba2c5e4d79 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:47.528266 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cbfcbcfb-6400-41d4-8ec0-4dba2c5e4d79 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:47.528775 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cbfcbcfb-6400-41d4-8ec0-4dba2c5e4d79 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:47.721015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-cbfcbcfb-6400-41d4-8ec0-4dba2c5e4d79 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:47.729173 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-cbfcbcfb-6400-41d4-8ec0-4dba2c5e4d79 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.214157 May 17 18:15:47.729760 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 250/495] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:47 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:47.738599 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e75911d1-1282-49a9-bde6-913dd0eaa930 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:47.739474 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-809f759f-799d-4fe3-875a-98856eedebe7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:47.740087 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-809f759f-799d-4fe3-875a-98856eedebe7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:47.747092 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e75911d1-1282-49a9-bde6-913dd0eaa930 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.243006 May 17 18:15:47.747307 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-809f759f-799d-4fe3-875a-98856eedebe7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:47.747700 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-809f759f-799d-4fe3-875a-98856eedebe7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:47.748104 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 246/496] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:47 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:47.748733 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-809f759f-799d-4fe3-875a-98856eedebe7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:47.749410 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-809f759f-799d-4fe3-875a-98856eedebe7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:47.883758 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-809f759f-799d-4fe3-875a-98856eedebe7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:47.894269 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-809f759f-799d-4fe3-875a-98856eedebe7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:47.895950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-809f759f-799d-4fe3-875a-98856eedebe7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:47.897227 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-809f759f-799d-4fe3-875a-98856eedebe7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.161655 May 17 18:15:47.898029 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 251/497] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:47 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:47.979857 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-065b638a-810e-4496-b2a4-b58fc0556418 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:47.980900 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-065b638a-810e-4496-b2a4-b58fc0556418 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:47.988065 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-065b638a-810e-4496-b2a4-b58fc0556418 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:47.993325 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9a6e8827-eda9-4fbc-b09f-fe58acdb1018 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:47.994999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9a6e8827-eda9-4fbc-b09f-fe58acdb1018 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:47.995177 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-065b638a-810e-4496-b2a4-b58fc0556418 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:47.995926 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-065b638a-810e-4496-b2a4-b58fc0556418 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:47.996376 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-065b638a-810e-4496-b2a4-b58fc0556418 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:48.001032 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9a6e8827-eda9-4fbc-b09f-fe58acdb1018 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:48.001486 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9a6e8827-eda9-4fbc-b09f-fe58acdb1018 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:48.002254 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9a6e8827-eda9-4fbc-b09f-fe58acdb1018 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:48.002717 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9a6e8827-eda9-4fbc-b09f-fe58acdb1018 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:48.201057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-065b638a-810e-4496-b2a4-b58fc0556418 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:48.210706 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-065b638a-810e-4496-b2a4-b58fc0556418 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.234917 May 17 18:15:48.213303 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 247/498] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:47 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:48.213451 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9a6e8827-eda9-4fbc-b09f-fe58acdb1018 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:48.217313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5c5e2133-7a1b-4d5d-8a35-e9e806af595b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:48.218099 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5c5e2133-7a1b-4d5d-8a35-e9e806af595b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:48.221575 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9a6e8827-eda9-4fbc-b09f-fe58acdb1018 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.232127 May 17 18:15:48.222333 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 252/499] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:47 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:48.225684 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5c5e2133-7a1b-4d5d-8a35-e9e806af595b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:48.226129 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5c5e2133-7a1b-4d5d-8a35-e9e806af595b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:48.226953 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5c5e2133-7a1b-4d5d-8a35-e9e806af595b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:48.227390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5c5e2133-7a1b-4d5d-8a35-e9e806af595b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:48.298201 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5c5e2133-7a1b-4d5d-8a35-e9e806af595b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:48.305591 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5c5e2133-7a1b-4d5d-8a35-e9e806af595b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1278 microversion: 2.1 time: 0.092600 May 17 18:15:48.306902 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 248/500] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:48 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:48.745321 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-740ba327-8f44-43df-97cc-65bfc0ddbb48 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:48.745854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-740ba327-8f44-43df-97cc-65bfc0ddbb48 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:48.752209 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-740ba327-8f44-43df-97cc-65bfc0ddbb48 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:48.752656 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-740ba327-8f44-43df-97cc-65bfc0ddbb48 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:48.753419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-740ba327-8f44-43df-97cc-65bfc0ddbb48 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:48.753857 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-740ba327-8f44-43df-97cc-65bfc0ddbb48 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:48.763816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-30e02417-31e2-4232-b8c1-acb93fa5da93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:48.764607 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-30e02417-31e2-4232-b8c1-acb93fa5da93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:48.770933 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-30e02417-31e2-4232-b8c1-acb93fa5da93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:48.771392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-30e02417-31e2-4232-b8c1-acb93fa5da93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:48.772173 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-30e02417-31e2-4232-b8c1-acb93fa5da93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:48.772614 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-30e02417-31e2-4232-b8c1-acb93fa5da93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:48.948980 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-740ba327-8f44-43df-97cc-65bfc0ddbb48 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:48.955079 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-30e02417-31e2-4232-b8c1-acb93fa5da93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:48.956392 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-740ba327-8f44-43df-97cc-65bfc0ddbb48 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1367 microversion: 2.1 time: 0.215065 May 17 18:15:48.956970 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 253/501] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:48 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:48.961613 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a45ca8cb-41da-489f-a105-fd0a95d98aaf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:48.962241 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a45ca8cb-41da-489f-a105-fd0a95d98aaf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:48.963618 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-30e02417-31e2-4232-b8c1-acb93fa5da93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.202902 May 17 18:15:48.966356 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 249/502] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:48 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:48.969843 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a45ca8cb-41da-489f-a105-fd0a95d98aaf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:48.970303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a45ca8cb-41da-489f-a105-fd0a95d98aaf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:48.971180 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a45ca8cb-41da-489f-a105-fd0a95d98aaf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:48.971628 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a45ca8cb-41da-489f-a105-fd0a95d98aaf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:49.097438 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a45ca8cb-41da-489f-a105-fd0a95d98aaf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:49.105277 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a45ca8cb-41da-489f-a105-fd0a95d98aaf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:49.106817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a45ca8cb-41da-489f-a105-fd0a95d98aaf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:49.107985 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a45ca8cb-41da-489f-a105-fd0a95d98aaf tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1737 microversion: 2.20 time: 0.149864 May 17 18:15:49.108548 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 254/503] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:48 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:49.228313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f7f1d7c5-3560-43d1-bdcd-39518d1e3520 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:49.229408 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f7f1d7c5-3560-43d1-bdcd-39518d1e3520 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:49.238985 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-24c62fdd-4575-4713-bcdc-824ebf7af564 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:49.239702 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-24c62fdd-4575-4713-bcdc-824ebf7af564 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:49.250249 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-24c62fdd-4575-4713-bcdc-824ebf7af564 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:49.250772 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-24c62fdd-4575-4713-bcdc-824ebf7af564 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:49.251573 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-24c62fdd-4575-4713-bcdc-824ebf7af564 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:49.252018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-24c62fdd-4575-4713-bcdc-824ebf7af564 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:49.252952 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7f1d7c5-3560-43d1-bdcd-39518d1e3520 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:49.254813 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7f1d7c5-3560-43d1-bdcd-39518d1e3520 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:49.258351 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7f1d7c5-3560-43d1-bdcd-39518d1e3520 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:49.260395 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7f1d7c5-3560-43d1-bdcd-39518d1e3520 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:49.522900 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-24c62fdd-4575-4713-bcdc-824ebf7af564 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:49.523891 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f7f1d7c5-3560-43d1-bdcd-39518d1e3520 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:49.532772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f7f1d7c5-3560-43d1-bdcd-39518d1e3520 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.308659 May 17 18:15:49.533358 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 250/504] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:49 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:49.545330 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-24c62fdd-4575-4713-bcdc-824ebf7af564 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.309686 May 17 18:15:49.546390 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 255/505] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:49 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:49.547710 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ed22331a-f271-4b4b-aec2-a77a17d2e02c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:49.548324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ed22331a-f271-4b4b-aec2-a77a17d2e02c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:49.555413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ed22331a-f271-4b4b-aec2-a77a17d2e02c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:49.555865 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ed22331a-f271-4b4b-aec2-a77a17d2e02c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:49.557997 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ed22331a-f271-4b4b-aec2-a77a17d2e02c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:49.557997 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ed22331a-f271-4b4b-aec2-a77a17d2e02c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:49.629572 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ed22331a-f271-4b4b-aec2-a77a17d2e02c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:49.638274 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ed22331a-f271-4b4b-aec2-a77a17d2e02c tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1288 microversion: 2.1 time: 0.094351 May 17 18:15:49.639090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 251/506] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:49 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1288 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:49.973433 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d5fa26d9-d5b7-43d3-821b-a2a30b1d0973 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:49.974149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d5fa26d9-d5b7-43d3-821b-a2a30b1d0973 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:49.981488 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d5fa26d9-d5b7-43d3-821b-a2a30b1d0973 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:49.982014 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d5fa26d9-d5b7-43d3-821b-a2a30b1d0973 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:49.982405 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-cdd56fad-d34c-4590-a131-49015a7021c1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:49.982909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d5fa26d9-d5b7-43d3-821b-a2a30b1d0973 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:49.983051 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-cdd56fad-d34c-4590-a131-49015a7021c1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:49.984077 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d5fa26d9-d5b7-43d3-821b-a2a30b1d0973 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:49.991163 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cdd56fad-d34c-4590-a131-49015a7021c1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:49.991889 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cdd56fad-d34c-4590-a131-49015a7021c1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:49.992672 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cdd56fad-d34c-4590-a131-49015a7021c1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:49.993111 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cdd56fad-d34c-4590-a131-49015a7021c1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:50.181866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d5fa26d9-d5b7-43d3-821b-a2a30b1d0973 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:50.184480 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-cdd56fad-d34c-4590-a131-49015a7021c1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:50.199085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d5fa26d9-d5b7-43d3-821b-a2a30b1d0973 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1556 microversion: 2.1 time: 0.229308 May 17 18:15:50.202313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-cdd56fad-d34c-4590-a131-49015a7021c1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.224293 May 17 18:15:50.203374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 252/507] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:49 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:50.218059 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 256/508] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:49 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1556 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:50.221814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-81d9eab9-7c4a-4cd6-bb36-b0c88ddc6042 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:50.222892 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-81d9eab9-7c4a-4cd6-bb36-b0c88ddc6042 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:50.230009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7c10835e-6427-4e47-9d72-5a6f0c81ccf8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:50.230517 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7c10835e-6427-4e47-9d72-5a6f0c81ccf8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:50.237807 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-81d9eab9-7c4a-4cd6-bb36-b0c88ddc6042 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:50.238264 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-81d9eab9-7c4a-4cd6-bb36-b0c88ddc6042 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:50.239083 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-81d9eab9-7c4a-4cd6-bb36-b0c88ddc6042 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:50.239523 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-81d9eab9-7c4a-4cd6-bb36-b0c88ddc6042 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:50.249706 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7c10835e-6427-4e47-9d72-5a6f0c81ccf8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:50.250160 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7c10835e-6427-4e47-9d72-5a6f0c81ccf8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:50.251180 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7c10835e-6427-4e47-9d72-5a6f0c81ccf8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:50.251624 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7c10835e-6427-4e47-9d72-5a6f0c81ccf8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:50.407977 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7c10835e-6427-4e47-9d72-5a6f0c81ccf8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183127 May 17 18:15:50.409366 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 257/509] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 17 18:15:50 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:15:50.529920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-81d9eab9-7c4a-4cd6-bb36-b0c88ddc6042 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:50.539162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-81d9eab9-7c4a-4cd6-bb36-b0c88ddc6042 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:50.541120 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-81d9eab9-7c4a-4cd6-bb36-b0c88ddc6042 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:50.552861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d43ca20d-7146-4b76-bcd9-90f848c62681 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:50.553960 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d43ca20d-7146-4b76-bcd9-90f848c62681 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:50.571331 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-81d9eab9-7c4a-4cd6-bb36-b0c88ddc6042 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1719 microversion: 2.20 time: 0.366400 May 17 18:15:50.576011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 253/510] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:50 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1719 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:50.577789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d43ca20d-7146-4b76-bcd9-90f848c62681 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:50.578265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d43ca20d-7146-4b76-bcd9-90f848c62681 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:50.580351 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d43ca20d-7146-4b76-bcd9-90f848c62681 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:50.580859 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d43ca20d-7146-4b76-bcd9-90f848c62681 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:50.593321 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8b9f8445-1e12-4beb-b131-ade42ac340a4 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:50.594095 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8b9f8445-1e12-4beb-b131-ade42ac340a4 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:50.611651 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8b9f8445-1e12-4beb-b131-ade42ac340a4 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:50.612130 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8b9f8445-1e12-4beb-b131-ade42ac340a4 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:50.615767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8b9f8445-1e12-4beb-b131-ade42ac340a4 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:50.616222 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8b9f8445-1e12-4beb-b131-ade42ac340a4 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:51.066515 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d43ca20d-7146-4b76-bcd9-90f848c62681 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:51.069868 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8b9f8445-1e12-4beb-b131-ade42ac340a4 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:51.078883 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8b9f8445-1e12-4beb-b131-ade42ac340a4 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.501669 May 17 18:15:51.083026 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d43ca20d-7146-4b76-bcd9-90f848c62681 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.537541 May 17 18:15:51.084353 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 258/511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:50 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:51.087029 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 254/512] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:50 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:51.093189 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b94f4b2f-d168-4b67-90e6-ba2f405f6d18 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:51.094170 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b94f4b2f-d168-4b67-90e6-ba2f405f6d18 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:51.097242 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-ec4cd833-e9ac-43b8-8d56-2963d32fa9cd req-f9d2bb0e-f3fe-4fac-b9d9-67b33f3bf1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5792551b-b2ce-425d-9831-77b469c883c8", "tag": "a29d526a-3dbb-4880-84ae-f0ec2191f0e2"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:51.102517 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b94f4b2f-d168-4b67-90e6-ba2f405f6d18 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:51.104023 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b94f4b2f-d168-4b67-90e6-ba2f405f6d18 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:51.105341 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b94f4b2f-d168-4b67-90e6-ba2f405f6d18 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:51.106086 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b94f4b2f-d168-4b67-90e6-ba2f405f6d18 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:51.114677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-ec4cd833-e9ac-43b8-8d56-2963d32fa9cd req-f9d2bb0e-f3fe-4fac-b9d9-67b33f3bf1cd service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:51.115505 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-ec4cd833-e9ac-43b8-8d56-2963d32fa9cd req-f9d2bb0e-f3fe-4fac-b9d9-67b33f3bf1cd service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:51.135914 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-ec4cd833-e9ac-43b8-8d56-2963d32fa9cd req-f9d2bb0e-f3fe-4fac-b9d9-67b33f3bf1cd service nova] Creating event network-changed:a29d526a-3dbb-4880-84ae-f0ec2191f0e2 for instance 5792551b-b2ce-425d-9831-77b469c883c8 on hv-cinder-84130 May 17 18:15:51.152902 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-ec4cd833-e9ac-43b8-8d56-2963d32fa9cd req-f9d2bb0e-f3fe-4fac-b9d9-67b33f3bf1cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063464 May 17 18:15:51.155264 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 255/513] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:51.221776 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f7cf76d9-af0c-41bb-9038-0944ac4848ad tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:51.222621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f7cf76d9-af0c-41bb-9038-0944ac4848ad tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:51.234770 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7cf76d9-af0c-41bb-9038-0944ac4848ad tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:51.235398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7cf76d9-af0c-41bb-9038-0944ac4848ad tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:51.241609 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7cf76d9-af0c-41bb-9038-0944ac4848ad tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:51.242310 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f7cf76d9-af0c-41bb-9038-0944ac4848ad tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:51.812024 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b94f4b2f-d168-4b67-90e6-ba2f405f6d18 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:51.819327 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b94f4b2f-d168-4b67-90e6-ba2f405f6d18 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1318 microversion: 2.1 time: 0.733640 May 17 18:15:51.819958 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 259/514] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:51 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:51.825132 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3f08bc33-f1d7-457a-85a7-18c6e9d2200d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:51.825934 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3f08bc33-f1d7-457a-85a7-18c6e9d2200d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:51.831829 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f08bc33-f1d7-457a-85a7-18c6e9d2200d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:51.832354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f08bc33-f1d7-457a-85a7-18c6e9d2200d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:51.833190 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f08bc33-f1d7-457a-85a7-18c6e9d2200d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:51.833625 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f08bc33-f1d7-457a-85a7-18c6e9d2200d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:51.857814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f7cf76d9-af0c-41bb-9038-0944ac4848ad tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:51.865585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f7cf76d9-af0c-41bb-9038-0944ac4848ad tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1370 microversion: 2.1 time: 0.649136 May 17 18:15:51.866264 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 256/515] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:51 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1370 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:52.074104 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3f08bc33-f1d7-457a-85a7-18c6e9d2200d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:52.083276 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3f08bc33-f1d7-457a-85a7-18c6e9d2200d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:52.084789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3f08bc33-f1d7-457a-85a7-18c6e9d2200d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:52.086053 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3f08bc33-f1d7-457a-85a7-18c6e9d2200d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1719 microversion: 2.20 time: 0.265128 May 17 18:15:52.086642 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 260/516] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:51 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1719 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:52.101552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bfc2583c-80a8-4002-83f9-5c47a5dbe0fe tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:52.101869 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-17989880-cda3-473f-a2ca-3a71351e1c4d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:52.102344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-bfc2583c-80a8-4002-83f9-5c47a5dbe0fe tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:52.103678 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-17989880-cda3-473f-a2ca-3a71351e1c4d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:52.109027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bfc2583c-80a8-4002-83f9-5c47a5dbe0fe tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:52.109478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bfc2583c-80a8-4002-83f9-5c47a5dbe0fe tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:52.109823 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17989880-cda3-473f-a2ca-3a71351e1c4d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:52.110259 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bfc2583c-80a8-4002-83f9-5c47a5dbe0fe tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:52.110643 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17989880-cda3-473f-a2ca-3a71351e1c4d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:52.110788 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bfc2583c-80a8-4002-83f9-5c47a5dbe0fe tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:52.111865 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17989880-cda3-473f-a2ca-3a71351e1c4d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:52.112467 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17989880-cda3-473f-a2ca-3a71351e1c4d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:52.453115 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-17989880-cda3-473f-a2ca-3a71351e1c4d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:52.461796 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-17989880-cda3-473f-a2ca-3a71351e1c4d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1712 microversion: 2.1 time: 0.363765 May 17 18:15:52.462692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-bfc2583c-80a8-4002-83f9-5c47a5dbe0fe tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:52.472073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 257/517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:52 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1712 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:52.477392 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-bfc2583c-80a8-4002-83f9-5c47a5dbe0fe tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.379428 May 17 18:15:52.479132 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 261/518] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:52 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:52.564941 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-f1f19f20-17c7-4391-bc0c-d165c1592c64 req-781f92df-b3a7-4a31-a512-3b1e0edc5b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6933d9-d646-4718-9297-741290e08790", "tag": "b5450332-d4eb-4a0d-8ea4-c788c95e97e0"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:52.573817 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-f1f19f20-17c7-4391-bc0c-d165c1592c64 req-781f92df-b3a7-4a31-a512-3b1e0edc5b48 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:52.574336 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-f1f19f20-17c7-4391-bc0c-d165c1592c64 req-781f92df-b3a7-4a31-a512-3b1e0edc5b48 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:52.585861 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-f1f19f20-17c7-4391-bc0c-d165c1592c64 req-781f92df-b3a7-4a31-a512-3b1e0edc5b48 service nova] Creating event network-changed:b5450332-d4eb-4a0d-8ea4-c788c95e97e0 for instance 1a6933d9-d646-4718-9297-741290e08790 on hv-cinder-84130 May 17 18:15:52.592622 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-f1f19f20-17c7-4391-bc0c-d165c1592c64 req-781f92df-b3a7-4a31-a512-3b1e0edc5b48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031538 May 17 18:15:52.593192 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 258/519] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:15:52.839707 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-90222469-601c-488d-aa62-4d77ed11cb63 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:52.840747 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-90222469-601c-488d-aa62-4d77ed11cb63 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:52.852368 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-90222469-601c-488d-aa62-4d77ed11cb63 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:52.854675 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-90222469-601c-488d-aa62-4d77ed11cb63 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:52.855448 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-90222469-601c-488d-aa62-4d77ed11cb63 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:52.855902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-90222469-601c-488d-aa62-4d77ed11cb63 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:52.885640 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3a8cc001-9544-484f-9a01-c215e9427ee7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:52.886353 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3a8cc001-9544-484f-9a01-c215e9427ee7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:52.902078 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3a8cc001-9544-484f-9a01-c215e9427ee7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:52.902644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3a8cc001-9544-484f-9a01-c215e9427ee7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:52.903474 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3a8cc001-9544-484f-9a01-c215e9427ee7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:52.903995 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3a8cc001-9544-484f-9a01-c215e9427ee7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.158659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-90222469-601c-488d-aa62-4d77ed11cb63 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:53.173769 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-90222469-601c-488d-aa62-4d77ed11cb63 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1318 microversion: 2.1 time: 0.340435 May 17 18:15:53.175085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 262/520] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:52 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:53.180185 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-31820476-dcc9-4e3f-9866-4153b140071d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:53.182678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-31820476-dcc9-4e3f-9866-4153b140071d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:53.189221 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31820476-dcc9-4e3f-9866-4153b140071d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:53.189934 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31820476-dcc9-4e3f-9866-4153b140071d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.191021 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31820476-dcc9-4e3f-9866-4153b140071d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:53.191901 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31820476-dcc9-4e3f-9866-4153b140071d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.229382 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3a8cc001-9544-484f-9a01-c215e9427ee7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:53.239675 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3a8cc001-9544-484f-9a01-c215e9427ee7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1565 microversion: 2.1 time: 0.360270 May 17 18:15:53.240726 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 259/521] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:52 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1565 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:53.246603 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-f094d7e5-09fd-4365-9515-ed2985e45f4e req-7b7e8d44-7b95-4187-8c9d-7c65938544fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f2d805-198e-4ea9-93fe-799e701c3924", "tag": "b0705e7f-39f9-4769-b628-04006cf4dca0"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:53.255232 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-f094d7e5-09fd-4365-9515-ed2985e45f4e req-7b7e8d44-7b95-4187-8c9d-7c65938544fd service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:53.255774 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-f094d7e5-09fd-4365-9515-ed2985e45f4e req-7b7e8d44-7b95-4187-8c9d-7c65938544fd service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.268726 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-f094d7e5-09fd-4365-9515-ed2985e45f4e req-7b7e8d44-7b95-4187-8c9d-7c65938544fd service nova] Creating event network-changed:b0705e7f-39f9-4769-b628-04006cf4dca0 for instance e7f2d805-198e-4ea9-93fe-799e701c3924 on hv-cinder-84130 May 17 18:15:53.274166 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-f094d7e5-09fd-4365-9515-ed2985e45f4e req-7b7e8d44-7b95-4187-8c9d-7c65938544fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031932 May 17 18:15:53.276760 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 260/522] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:53.283428 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-2d5ecb6e-eb19-4850-97d6-3e5ca078845a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:53.284336 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-2d5ecb6e-eb19-4850-97d6-3e5ca078845a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:53.297007 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2d5ecb6e-eb19-4850-97d6-3e5ca078845a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:53.297475 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2d5ecb6e-eb19-4850-97d6-3e5ca078845a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.298278 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2d5ecb6e-eb19-4850-97d6-3e5ca078845a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:53.298843 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2d5ecb6e-eb19-4850-97d6-3e5ca078845a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.414264 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-2d5ecb6e-eb19-4850-97d6-3e5ca078845a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135719 May 17 18:15:53.414899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 261/523] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 17 18:15:53 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:53.423224 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-31820476-dcc9-4e3f-9866-4153b140071d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:53.434043 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-31820476-dcc9-4e3f-9866-4153b140071d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:53.435943 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-31820476-dcc9-4e3f-9866-4153b140071d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:53.437351 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-31820476-dcc9-4e3f-9866-4153b140071d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1719 microversion: 2.20 time: 0.260828 May 17 18:15:53.438152 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 263/524] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:53 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1719 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:53.481805 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-dc87b665-7685-4112-bb18-5b0fab5e08da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:53.482950 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-dc87b665-7685-4112-bb18-5b0fab5e08da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:53.490799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc87b665-7685-4112-bb18-5b0fab5e08da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:53.491492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc87b665-7685-4112-bb18-5b0fab5e08da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.493139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc87b665-7685-4112-bb18-5b0fab5e08da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:53.493884 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc87b665-7685-4112-bb18-5b0fab5e08da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.495588 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-847157eb-ee6d-4fc8-8ea3-48d41cd3a232 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:53.496213 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-847157eb-ee6d-4fc8-8ea3-48d41cd3a232 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:53.502248 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-847157eb-ee6d-4fc8-8ea3-48d41cd3a232 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:53.502948 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-847157eb-ee6d-4fc8-8ea3-48d41cd3a232 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.503919 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-847157eb-ee6d-4fc8-8ea3-48d41cd3a232 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:53.504363 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-847157eb-ee6d-4fc8-8ea3-48d41cd3a232 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.726221 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-dc87b665-7685-4112-bb18-5b0fab5e08da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:53.733283 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-847157eb-ee6d-4fc8-8ea3-48d41cd3a232 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:53.734326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-dc87b665-7685-4112-bb18-5b0fab5e08da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1716 microversion: 2.1 time: 0.258622 May 17 18:15:53.745793 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-847157eb-ee6d-4fc8-8ea3-48d41cd3a232 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.251038 May 17 18:15:53.746375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 262/525] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:53 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1716 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:53.751302 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-4c73a575-a96e-4922-82c0-bc19ee9cd05d req-b597d650-0efd-48af-bd72-e1c26cb0fa61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769abf30-807c-41f0-bd94-0809137c0155", "name": "network-vif-unplugged", "status": "completed", "tag": "cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:53.753113 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 264/526] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:53 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:53.768413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-4c73a575-a96e-4922-82c0-bc19ee9cd05d req-b597d650-0efd-48af-bd72-e1c26cb0fa61 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:53.769131 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-4c73a575-a96e-4922-82c0-bc19ee9cd05d req-b597d650-0efd-48af-bd72-e1c26cb0fa61 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:53.781422 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-4c73a575-a96e-4922-82c0-bc19ee9cd05d req-b597d650-0efd-48af-bd72-e1c26cb0fa61 service nova] Creating event network-vif-unplugged:cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb for instance 769abf30-807c-41f0-bd94-0809137c0155 on hv-cinder-84130 May 17 18:15:53.786598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-4c73a575-a96e-4922-82c0-bc19ee9cd05d req-b597d650-0efd-48af-bd72-e1c26cb0fa61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038712 May 17 18:15:53.787370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 263/527] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:54.191324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c02180d9-5c7f-4f12-b9e4-f36ea18fabd6 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:54.192155 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c02180d9-5c7f-4f12-b9e4-f36ea18fabd6 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:54.198833 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c02180d9-5c7f-4f12-b9e4-f36ea18fabd6 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:54.199287 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c02180d9-5c7f-4f12-b9e4-f36ea18fabd6 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:54.200062 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c02180d9-5c7f-4f12-b9e4-f36ea18fabd6 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:54.200503 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c02180d9-5c7f-4f12-b9e4-f36ea18fabd6 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:54.329740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c02180d9-5c7f-4f12-b9e4-f36ea18fabd6 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:54.337031 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c02180d9-5c7f-4f12-b9e4-f36ea18fabd6 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1318 microversion: 2.1 time: 0.149594 May 17 18:15:54.338182 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 265/528] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:54 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:54.458314 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-eabf02b4-b79d-4a3a-a0aa-bad676d9e7a2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:54.458963 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-eabf02b4-b79d-4a3a-a0aa-bad676d9e7a2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:54.465801 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eabf02b4-b79d-4a3a-a0aa-bad676d9e7a2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:54.466253 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eabf02b4-b79d-4a3a-a0aa-bad676d9e7a2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:54.467064 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eabf02b4-b79d-4a3a-a0aa-bad676d9e7a2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:54.467503 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eabf02b4-b79d-4a3a-a0aa-bad676d9e7a2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:54.604018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-eabf02b4-b79d-4a3a-a0aa-bad676d9e7a2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:54.611792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-eabf02b4-b79d-4a3a-a0aa-bad676d9e7a2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:54.613293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-eabf02b4-b79d-4a3a-a0aa-bad676d9e7a2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:54.614436 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-eabf02b4-b79d-4a3a-a0aa-bad676d9e7a2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1719 microversion: 2.20 time: 0.160918 May 17 18:15:54.615210 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 264/529] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:54 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:15:54.759983 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-39b7d3a0-9049-41f2-acbf-2df2fb702226 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:54.760597 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-39b7d3a0-9049-41f2-acbf-2df2fb702226 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:54.766643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39b7d3a0-9049-41f2-acbf-2df2fb702226 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:54.767097 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39b7d3a0-9049-41f2-acbf-2df2fb702226 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:54.767870 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39b7d3a0-9049-41f2-acbf-2df2fb702226 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:54.768314 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39b7d3a0-9049-41f2-acbf-2df2fb702226 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:54.895376 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-39b7d3a0-9049-41f2-acbf-2df2fb702226 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:54.903539 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-39b7d3a0-9049-41f2-acbf-2df2fb702226 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.147458 May 17 18:15:54.912562 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 266/530] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:54 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:55.348895 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-75cd6951-6898-4767-ae3e-b932761dd271 req-4fa6ab43-2efd-4f5b-a873-64be0b0c383c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1966aa90-f5e3-4591-8105-69f6cc0fbdfb", "tag": "c45336db-0e36-4d75-8c9b-f63dc16532f1"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:55.359866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-584b909e-649e-4abb-aff5-98451d17e1a9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:55.362963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-584b909e-649e-4abb-aff5-98451d17e1a9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:55.363641 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-75cd6951-6898-4767-ae3e-b932761dd271 req-4fa6ab43-2efd-4f5b-a873-64be0b0c383c service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:55.364183 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-75cd6951-6898-4767-ae3e-b932761dd271 req-4fa6ab43-2efd-4f5b-a873-64be0b0c383c service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:55.381166 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-584b909e-649e-4abb-aff5-98451d17e1a9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:55.383344 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-75cd6951-6898-4767-ae3e-b932761dd271 req-4fa6ab43-2efd-4f5b-a873-64be0b0c383c service nova] Creating event network-changed:c45336db-0e36-4d75-8c9b-f63dc16532f1 for instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb on hv-cinder-84130 May 17 18:15:55.387155 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-584b909e-649e-4abb-aff5-98451d17e1a9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:55.389732 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-584b909e-649e-4abb-aff5-98451d17e1a9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:55.392073 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-584b909e-649e-4abb-aff5-98451d17e1a9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:55.392792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-75cd6951-6898-4767-ae3e-b932761dd271 req-4fa6ab43-2efd-4f5b-a873-64be0b0c383c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049223 May 17 18:15:55.393830 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 265/531] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:55.635179 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-82428707-32ce-4d5d-894f-3609a872f181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:55.636557 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-82428707-32ce-4d5d-894f-3609a872f181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:55.643860 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82428707-32ce-4d5d-894f-3609a872f181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:55.644659 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82428707-32ce-4d5d-894f-3609a872f181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:55.645441 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82428707-32ce-4d5d-894f-3609a872f181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:55.645875 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-82428707-32ce-4d5d-894f-3609a872f181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:55.682620 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-584b909e-649e-4abb-aff5-98451d17e1a9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:55.689825 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-584b909e-649e-4abb-aff5-98451d17e1a9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1318 microversion: 2.1 time: 0.338182 May 17 18:15:55.690390 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 267/532] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:55 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:55.784833 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-82428707-32ce-4d5d-894f-3609a872f181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:55.793027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-82428707-32ce-4d5d-894f-3609a872f181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:55.794512 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-82428707-32ce-4d5d-894f-3609a872f181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:55.795677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-82428707-32ce-4d5d-894f-3609a872f181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1719 microversion: 2.20 time: 0.166606 May 17 18:15:55.796232 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 266/533] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:55 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:55.920612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6e38f949-eaa5-4fab-ad74-3e9c85c4e449 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:55.921143 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6e38f949-eaa5-4fab-ad74-3e9c85c4e449 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:55.927011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6e38f949-eaa5-4fab-ad74-3e9c85c4e449 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:55.927470 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6e38f949-eaa5-4fab-ad74-3e9c85c4e449 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:55.928239 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6e38f949-eaa5-4fab-ad74-3e9c85c4e449 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:55.928675 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6e38f949-eaa5-4fab-ad74-3e9c85c4e449 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:56.055262 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6e38f949-eaa5-4fab-ad74-3e9c85c4e449 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:56.063008 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6e38f949-eaa5-4fab-ad74-3e9c85c4e449 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.146262 May 17 18:15:56.063581 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 268/534] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:55 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:56.706638 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ba92c087-3b0c-47f6-8068-bd803ef4132b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:56.707248 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ba92c087-3b0c-47f6-8068-bd803ef4132b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:56.713497 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ba92c087-3b0c-47f6-8068-bd803ef4132b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:56.713951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ba92c087-3b0c-47f6-8068-bd803ef4132b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:56.714733 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ba92c087-3b0c-47f6-8068-bd803ef4132b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:56.715165 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ba92c087-3b0c-47f6-8068-bd803ef4132b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:56.813394 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c9bc04af-b20c-4e93-ad3f-3845fe706c8d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:56.814007 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c9bc04af-b20c-4e93-ad3f-3845fe706c8d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:56.820618 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c9bc04af-b20c-4e93-ad3f-3845fe706c8d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:56.821071 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c9bc04af-b20c-4e93-ad3f-3845fe706c8d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:56.822520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c9bc04af-b20c-4e93-ad3f-3845fe706c8d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:56.823541 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c9bc04af-b20c-4e93-ad3f-3845fe706c8d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:56.841488 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ba92c087-3b0c-47f6-8068-bd803ef4132b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:56.848700 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ba92c087-3b0c-47f6-8068-bd803ef4132b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1318 microversion: 2.1 time: 0.145960 May 17 18:15:56.849267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 267/535] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:56 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:56.951362 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c9bc04af-b20c-4e93-ad3f-3845fe706c8d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:56.958986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c9bc04af-b20c-4e93-ad3f-3845fe706c8d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:56.960480 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c9bc04af-b20c-4e93-ad3f-3845fe706c8d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:56.961609 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c9bc04af-b20c-4e93-ad3f-3845fe706c8d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1722 microversion: 2.20 time: 0.152161 May 17 18:15:56.962184 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 269/536] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:56 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:15:56.979198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-aa126f6b-b7c1-4afa-ada8-1e7173687bbc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af7cb74e-9a93-4adb-b6e0-962b25eddef3"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:56.980252 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-aa126f6b-b7c1-4afa-ada8-1e7173687bbc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:56.986135 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa126f6b-b7c1-4afa-ada8-1e7173687bbc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:56.986597 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa126f6b-b7c1-4afa-ada8-1e7173687bbc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:56.987378 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa126f6b-b7c1-4afa-ada8-1e7173687bbc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:56.987817 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-aa126f6b-b7c1-4afa-ada8-1e7173687bbc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:57.081427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-84724442-9ecb-4b3f-b882-9976c02c96e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:57.082044 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-84724442-9ecb-4b3f-b882-9976c02c96e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:57.088740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-84724442-9ecb-4b3f-b882-9976c02c96e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:57.089346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-84724442-9ecb-4b3f-b882-9976c02c96e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:57.090068 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-84724442-9ecb-4b3f-b882-9976c02c96e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:57.090511 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-84724442-9ecb-4b3f-b882-9976c02c96e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:57.223955 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-84724442-9ecb-4b3f-b882-9976c02c96e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:57.231463 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-84724442-9ecb-4b3f-b882-9976c02c96e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.154360 May 17 18:15:57.232037 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 270/537] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:57 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:15:57.263782 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-aa126f6b-b7c1-4afa-ada8-1e7173687bbc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "POST /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288954 May 17 18:15:57.264386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 268/538] 10.222.0.25 () {62 vars in 1363 bytes} [Tue May 17 18:15:56 2022] POST /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:15:57.373773 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c40b6801-193c-492b-af54-3c76212287d7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:57.374367 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c40b6801-193c-492b-af54-3c76212287d7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:57.380211 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c40b6801-193c-492b-af54-3c76212287d7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:57.380665 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c40b6801-193c-492b-af54-3c76212287d7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:57.381427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c40b6801-193c-492b-af54-3c76212287d7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:57.381865 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c40b6801-193c-492b-af54-3c76212287d7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:57.472481 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c40b6801-193c-492b-af54-3c76212287d7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "POST /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/action" status: 202 len: 0 microversion: 2.20 time: 0.102488 May 17 18:15:57.473093 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 271/539] 10.222.0.25 () {62 vars in 1318 bytes} [Tue May 17 18:15:57 2022] POST /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:15:57.481153 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-bcfe84e4-9e82-4521-9834-2413e8b8b2fb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:57.481957 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-bcfe84e4-9e82-4521-9834-2413e8b8b2fb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:57.489254 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bcfe84e4-9e82-4521-9834-2413e8b8b2fb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:57.489698 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bcfe84e4-9e82-4521-9834-2413e8b8b2fb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:57.490666 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bcfe84e4-9e82-4521-9834-2413e8b8b2fb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:57.491100 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bcfe84e4-9e82-4521-9834-2413e8b8b2fb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:57.629963 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-bcfe84e4-9e82-4521-9834-2413e8b8b2fb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:57.650317 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-bcfe84e4-9e82-4521-9834-2413e8b8b2fb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:57.656815 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-bcfe84e4-9e82-4521-9834-2413e8b8b2fb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:57.658335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-bcfe84e4-9e82-4521-9834-2413e8b8b2fb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1808 microversion: 2.20 time: 0.181001 May 17 18:15:57.662550 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 269/540] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:57 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:57.866831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8b09b541-2d52-4400-8a28-94060c65c0d5 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:57.869022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8b09b541-2d52-4400-8a28-94060c65c0d5 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:57.875771 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8b09b541-2d52-4400-8a28-94060c65c0d5 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:57.876241 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8b09b541-2d52-4400-8a28-94060c65c0d5 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:57.877024 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8b09b541-2d52-4400-8a28-94060c65c0d5 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:57.877475 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8b09b541-2d52-4400-8a28-94060c65c0d5 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:58.009958 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8b09b541-2d52-4400-8a28-94060c65c0d5 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:58.031396 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8b09b541-2d52-4400-8a28-94060c65c0d5 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1318 microversion: 2.1 time: 0.169299 May 17 18:15:58.032292 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 272/541] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:57 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:58.248589 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-2801197b-d5e2-49c2-8510-c36f6e4136dc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:58.249224 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-2801197b-d5e2-49c2-8510-c36f6e4136dc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:58.255380 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2801197b-d5e2-49c2-8510-c36f6e4136dc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:58.255830 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2801197b-d5e2-49c2-8510-c36f6e4136dc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:58.256579 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2801197b-d5e2-49c2-8510-c36f6e4136dc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:58.257014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2801197b-d5e2-49c2-8510-c36f6e4136dc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:58.427387 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-2801197b-d5e2-49c2-8510-c36f6e4136dc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:58.435266 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-2801197b-d5e2-49c2-8510-c36f6e4136dc tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.190464 May 17 18:15:58.436741 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 270/542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:58 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:58.677376 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-170fd6d8-b8a6-45ef-a423-402bf0976f0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:58.679093 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-170fd6d8-b8a6-45ef-a423-402bf0976f0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:58.685687 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-170fd6d8-b8a6-45ef-a423-402bf0976f0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:58.686431 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-170fd6d8-b8a6-45ef-a423-402bf0976f0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:58.687332 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-170fd6d8-b8a6-45ef-a423-402bf0976f0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:58.688015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-170fd6d8-b8a6-45ef-a423-402bf0976f0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:58.823265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-170fd6d8-b8a6-45ef-a423-402bf0976f0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:58.831690 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-170fd6d8-b8a6-45ef-a423-402bf0976f0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:58.833199 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-170fd6d8-b8a6-45ef-a423-402bf0976f0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:58.834359 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-170fd6d8-b8a6-45ef-a423-402bf0976f0a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1748 microversion: 2.20 time: 0.161246 May 17 18:15:58.835216 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 273/543] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:58 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:59.049013 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-720a0c91-a797-4921-9994-f04526091680 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:59.049627 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-720a0c91-a797-4921-9994-f04526091680 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:59.055450 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-720a0c91-a797-4921-9994-f04526091680 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:59.057048 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-720a0c91-a797-4921-9994-f04526091680 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:59.057831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-720a0c91-a797-4921-9994-f04526091680 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:59.058274 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-720a0c91-a797-4921-9994-f04526091680 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:59.413160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-720a0c91-a797-4921-9994-f04526091680 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:59.421267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-720a0c91-a797-4921-9994-f04526091680 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1318 microversion: 2.1 time: 0.376041 May 17 18:15:59.421838 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 271/544] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:59 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:59.453137 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a7b4cd33-e386-4bbd-9870-2b69ec6a943b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:59.453753 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a7b4cd33-e386-4bbd-9870-2b69ec6a943b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:59.461040 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a7b4cd33-e386-4bbd-9870-2b69ec6a943b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:59.461503 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a7b4cd33-e386-4bbd-9870-2b69ec6a943b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:59.462760 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a7b4cd33-e386-4bbd-9870-2b69ec6a943b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:59.462956 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a7b4cd33-e386-4bbd-9870-2b69ec6a943b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:59.597562 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a7b4cd33-e386-4bbd-9870-2b69ec6a943b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:15:59.605825 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a7b4cd33-e386-4bbd-9870-2b69ec6a943b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.156457 May 17 18:15:59.606607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 274/545] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:15:59 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:59.854734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ef84647e-6846-4f48-ab51-0fa98d358a07 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:59.855254 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ef84647e-6846-4f48-ab51-0fa98d358a07 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:15:59.861777 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef84647e-6846-4f48-ab51-0fa98d358a07 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:59.862231 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef84647e-6846-4f48-ab51-0fa98d358a07 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:59.863528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef84647e-6846-4f48-ab51-0fa98d358a07 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:59.863528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef84647e-6846-4f48-ab51-0fa98d358a07 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:59.874457 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-a8732a2a-c0c8-4791-b984-3637551cff81 req-cbe5b6ab-98b5-4df5-9b71-c9c1f3efe752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f2d805-198e-4ea9-93fe-799e701c3924", "name": "network-vif-plugged", "status": "completed", "tag": "b0705e7f-39f9-4769-b628-04006cf4dca0"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:15:59.883912 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-a8732a2a-c0c8-4791-b984-3637551cff81 req-cbe5b6ab-98b5-4df5-9b71-c9c1f3efe752 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:59.884610 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-a8732a2a-c0c8-4791-b984-3637551cff81 req-cbe5b6ab-98b5-4df5-9b71-c9c1f3efe752 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:59.905547 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-a8732a2a-c0c8-4791-b984-3637551cff81 req-cbe5b6ab-98b5-4df5-9b71-c9c1f3efe752 service nova] Creating event network-vif-plugged:b0705e7f-39f9-4769-b628-04006cf4dca0 for instance e7f2d805-198e-4ea9-93fe-799e701c3924 on hv-cinder-84130 May 17 18:15:59.912221 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-a8732a2a-c0c8-4791-b984-3637551cff81 req-cbe5b6ab-98b5-4df5-9b71-c9c1f3efe752 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041767 May 17 18:15:59.913773 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 275/546] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:16:00.069304 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ef84647e-6846-4f48-ab51-0fa98d358a07 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:00.079578 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ef84647e-6846-4f48-ab51-0fa98d358a07 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:00.081694 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ef84647e-6846-4f48-ab51-0fa98d358a07 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:00.083271 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ef84647e-6846-4f48-ab51-0fa98d358a07 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.233856 May 17 18:16:00.084064 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 272/547] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:15:59 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:00.438334 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-05c18dad-befb-458e-842e-e2a091026860 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:00.439052 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-05c18dad-befb-458e-842e-e2a091026860 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:00.445255 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05c18dad-befb-458e-842e-e2a091026860 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:00.445701 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05c18dad-befb-458e-842e-e2a091026860 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:00.447223 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05c18dad-befb-458e-842e-e2a091026860 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:00.447667 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05c18dad-befb-458e-842e-e2a091026860 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:00.584232 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-05c18dad-befb-458e-842e-e2a091026860 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:00.592304 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-05c18dad-befb-458e-842e-e2a091026860 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1318 microversion: 2.1 time: 0.158171 May 17 18:16:00.592881 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 276/548] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:00 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:00.624067 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6d83619c-6bdb-45f2-a33b-368206ecf5cf tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:00.624769 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6d83619c-6bdb-45f2-a33b-368206ecf5cf tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:00.631433 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d83619c-6bdb-45f2-a33b-368206ecf5cf tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:00.631904 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d83619c-6bdb-45f2-a33b-368206ecf5cf tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:00.632719 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d83619c-6bdb-45f2-a33b-368206ecf5cf tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:00.633157 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6d83619c-6bdb-45f2-a33b-368206ecf5cf tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:00.758917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6d83619c-6bdb-45f2-a33b-368206ecf5cf tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:00.766250 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6d83619c-6bdb-45f2-a33b-368206ecf5cf tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.146102 May 17 18:16:00.766857 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 273/549] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:00 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:01.102077 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5bad54bd-815b-4aab-a00e-4d6a537124d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:01.102837 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5bad54bd-815b-4aab-a00e-4d6a537124d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:01.108988 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5bad54bd-815b-4aab-a00e-4d6a537124d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:01.109445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5bad54bd-815b-4aab-a00e-4d6a537124d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:01.110217 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5bad54bd-815b-4aab-a00e-4d6a537124d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:01.110702 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5bad54bd-815b-4aab-a00e-4d6a537124d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:01.238615 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5bad54bd-815b-4aab-a00e-4d6a537124d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:01.247547 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5bad54bd-815b-4aab-a00e-4d6a537124d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:01.249037 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5bad54bd-815b-4aab-a00e-4d6a537124d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:01.250208 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5bad54bd-815b-4aab-a00e-4d6a537124d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.151943 May 17 18:16:01.256028 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 277/550] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:01 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:01.610485 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-17055206-7ed9-4b6d-9d9c-12e071910644 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:01.611043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-17055206-7ed9-4b6d-9d9c-12e071910644 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:01.616894 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17055206-7ed9-4b6d-9d9c-12e071910644 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:01.617346 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17055206-7ed9-4b6d-9d9c-12e071910644 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:01.619446 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17055206-7ed9-4b6d-9d9c-12e071910644 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:01.619913 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-17055206-7ed9-4b6d-9d9c-12e071910644 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:01.751340 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-17055206-7ed9-4b6d-9d9c-12e071910644 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:01.758516 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-17055206-7ed9-4b6d-9d9c-12e071910644 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1507 microversion: 2.1 time: 0.152081 May 17 18:16:01.759686 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 274/551] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:01 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:01.775578 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-59d573b9-0cf3-473d-96a1-7edec3afa352 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93dbb921-9409-420a-bb6d-559a8ad5d209", "device": "/dev/sdb"}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:01.776675 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-59d573b9-0cf3-473d-96a1-7edec3afa352 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:01.782470 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e43cf156-32cd-4899-8cc3-27a868d72b02 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:01.783025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59d573b9-0cf3-473d-96a1-7edec3afa352 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:01.783154 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e43cf156-32cd-4899-8cc3-27a868d72b02 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:01.783478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59d573b9-0cf3-473d-96a1-7edec3afa352 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:01.784248 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59d573b9-0cf3-473d-96a1-7edec3afa352 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:01.784687 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59d573b9-0cf3-473d-96a1-7edec3afa352 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:01.788940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e43cf156-32cd-4899-8cc3-27a868d72b02 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:01.789446 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e43cf156-32cd-4899-8cc3-27a868d72b02 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:01.790205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e43cf156-32cd-4899-8cc3-27a868d72b02 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:01.790684 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e43cf156-32cd-4899-8cc3-27a868d72b02 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:01.971359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e43cf156-32cd-4899-8cc3-27a868d72b02 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:01.980123 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e43cf156-32cd-4899-8cc3-27a868d72b02 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.201278 May 17 18:16:01.980718 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 275/552] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:01 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:01.985143 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-e3189e7c-aa42-4769-9f5b-246ae4eac14c req-263a37a1-b792-4c92-9f41-2b18868620ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5792551b-b2ce-425d-9831-77b469c883c8", "name": "network-vif-plugged", "status": "completed", "tag": "a29d526a-3dbb-4880-84ae-f0ec2191f0e2"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:01.993780 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-e3189e7c-aa42-4769-9f5b-246ae4eac14c req-263a37a1-b792-4c92-9f41-2b18868620ec service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:01.994290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-e3189e7c-aa42-4769-9f5b-246ae4eac14c req-263a37a1-b792-4c92-9f41-2b18868620ec service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:02.005881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-e3189e7c-aa42-4769-9f5b-246ae4eac14c req-263a37a1-b792-4c92-9f41-2b18868620ec service nova] Creating event network-vif-plugged:a29d526a-3dbb-4880-84ae-f0ec2191f0e2 for instance 5792551b-b2ce-425d-9831-77b469c883c8 on hv-cinder-84130 May 17 18:16:02.011657 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-e3189e7c-aa42-4769-9f5b-246ae4eac14c req-263a37a1-b792-4c92-9f41-2b18868620ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029798 May 17 18:16:02.012257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 276/553] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:02.269259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5a62265f-dadb-457f-b02a-965199ba7b7a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:02.269988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5a62265f-dadb-457f-b02a-965199ba7b7a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:02.277391 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5a62265f-dadb-457f-b02a-965199ba7b7a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:02.277844 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5a62265f-dadb-457f-b02a-965199ba7b7a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:02.278653 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5a62265f-dadb-457f-b02a-965199ba7b7a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:02.279091 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5a62265f-dadb-457f-b02a-965199ba7b7a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:02.414292 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5a62265f-dadb-457f-b02a-965199ba7b7a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:02.423935 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5a62265f-dadb-457f-b02a-965199ba7b7a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:02.425467 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5a62265f-dadb-457f-b02a-965199ba7b7a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:02.426666 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5a62265f-dadb-457f-b02a-965199ba7b7a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.161659 May 17 18:16:02.427229 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 277/554] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:02 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:02.996745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-13a49f0d-dee6-4a60-ad0d-e1a716ad56c5 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:02.997707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-13a49f0d-dee6-4a60-ad0d-e1a716ad56c5 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:03.003881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-13a49f0d-dee6-4a60-ad0d-e1a716ad56c5 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:03.004345 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-13a49f0d-dee6-4a60-ad0d-e1a716ad56c5 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:03.005139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-13a49f0d-dee6-4a60-ad0d-e1a716ad56c5 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:03.005586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-13a49f0d-dee6-4a60-ad0d-e1a716ad56c5 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:03.148021 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-13a49f0d-dee6-4a60-ad0d-e1a716ad56c5 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:03.156167 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-13a49f0d-dee6-4a60-ad0d-e1a716ad56c5 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.163262 May 17 18:16:03.156737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 278/555] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:02 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:03.446211 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6ecf0888-ecb7-4487-ae72-433e2dd4fd39 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:03.447609 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6ecf0888-ecb7-4487-ae72-433e2dd4fd39 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:03.453711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ecf0888-ecb7-4487-ae72-433e2dd4fd39 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:03.454242 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ecf0888-ecb7-4487-ae72-433e2dd4fd39 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:03.455220 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ecf0888-ecb7-4487-ae72-433e2dd4fd39 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:03.455731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ecf0888-ecb7-4487-ae72-433e2dd4fd39 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:03.593168 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6ecf0888-ecb7-4487-ae72-433e2dd4fd39 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:03.601835 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6ecf0888-ecb7-4487-ae72-433e2dd4fd39 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:03.603433 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6ecf0888-ecb7-4487-ae72-433e2dd4fd39 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:03.604590 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6ecf0888-ecb7-4487-ae72-433e2dd4fd39 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.162869 May 17 18:16:03.605146 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 279/556] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:03 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:04.172835 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a57dbd9d-e83d-494b-a45b-c7b83b3462d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:04.173544 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a57dbd9d-e83d-494b-a45b-c7b83b3462d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:04.180040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57dbd9d-e83d-494b-a45b-c7b83b3462d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:04.180444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57dbd9d-e83d-494b-a45b-c7b83b3462d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:04.181855 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57dbd9d-e83d-494b-a45b-c7b83b3462d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:04.182295 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57dbd9d-e83d-494b-a45b-c7b83b3462d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:04.319791 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a57dbd9d-e83d-494b-a45b-c7b83b3462d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:04.328114 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a57dbd9d-e83d-494b-a45b-c7b83b3462d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.159080 May 17 18:16:04.328700 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 280/557] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:04 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:04.623204 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b452d0a2-44a5-4c53-a0b1-f13ae7e6412a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:04.623819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b452d0a2-44a5-4c53-a0b1-f13ae7e6412a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:04.629931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b452d0a2-44a5-4c53-a0b1-f13ae7e6412a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:04.630409 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b452d0a2-44a5-4c53-a0b1-f13ae7e6412a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:04.631216 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b452d0a2-44a5-4c53-a0b1-f13ae7e6412a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:04.631646 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b452d0a2-44a5-4c53-a0b1-f13ae7e6412a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:04.773196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b452d0a2-44a5-4c53-a0b1-f13ae7e6412a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:04.782669 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b452d0a2-44a5-4c53-a0b1-f13ae7e6412a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:04.784132 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b452d0a2-44a5-4c53-a0b1-f13ae7e6412a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:04.787672 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b452d0a2-44a5-4c53-a0b1-f13ae7e6412a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.166101 May 17 18:16:04.788286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 281/558] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:04 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:05.347176 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-075d3cb4-a76a-4e9c-8c71-68bf8f9a6c10 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:05.348710 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-075d3cb4-a76a-4e9c-8c71-68bf8f9a6c10 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:05.357897 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-075d3cb4-a76a-4e9c-8c71-68bf8f9a6c10 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:05.358359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-075d3cb4-a76a-4e9c-8c71-68bf8f9a6c10 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:05.359175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-075d3cb4-a76a-4e9c-8c71-68bf8f9a6c10 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:05.359620 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-075d3cb4-a76a-4e9c-8c71-68bf8f9a6c10 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:05.520916 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-075d3cb4-a76a-4e9c-8c71-68bf8f9a6c10 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:05.530110 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-075d3cb4-a76a-4e9c-8c71-68bf8f9a6c10 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.187292 May 17 18:16:05.530820 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 282/559] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:05 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:05.805271 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5446709d-01ff-4dbb-984b-586175d7aa83 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:05.807314 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5446709d-01ff-4dbb-984b-586175d7aa83 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:05.818183 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5446709d-01ff-4dbb-984b-586175d7aa83 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:05.818719 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5446709d-01ff-4dbb-984b-586175d7aa83 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:05.819517 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5446709d-01ff-4dbb-984b-586175d7aa83 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:05.819954 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5446709d-01ff-4dbb-984b-586175d7aa83 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:05.956397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5446709d-01ff-4dbb-984b-586175d7aa83 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:05.966158 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5446709d-01ff-4dbb-984b-586175d7aa83 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:05.967698 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5446709d-01ff-4dbb-984b-586175d7aa83 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:05.968891 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5446709d-01ff-4dbb-984b-586175d7aa83 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.167561 May 17 18:16:05.969442 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 283/560] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:05 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:06.548750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8a76f107-675f-4d10-9025-5b772a0b6e2d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:06.549549 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8a76f107-675f-4d10-9025-5b772a0b6e2d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:06.557221 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a76f107-675f-4d10-9025-5b772a0b6e2d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:06.557666 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a76f107-675f-4d10-9025-5b772a0b6e2d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:06.558494 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a76f107-675f-4d10-9025-5b772a0b6e2d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:06.558960 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a76f107-675f-4d10-9025-5b772a0b6e2d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:06.699833 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8a76f107-675f-4d10-9025-5b772a0b6e2d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:06.707080 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8a76f107-675f-4d10-9025-5b772a0b6e2d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.162865 May 17 18:16:06.707640 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 284/561] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:06 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:06.987424 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b447c25e-dcf5-481c-ab2c-6bab037f04d2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:06.988025 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b447c25e-dcf5-481c-ab2c-6bab037f04d2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:06.995146 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b447c25e-dcf5-481c-ab2c-6bab037f04d2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:06.995567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b447c25e-dcf5-481c-ab2c-6bab037f04d2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:06.996343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b447c25e-dcf5-481c-ab2c-6bab037f04d2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:06.996786 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b447c25e-dcf5-481c-ab2c-6bab037f04d2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:07.130789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b447c25e-dcf5-481c-ab2c-6bab037f04d2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:07.139950 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b447c25e-dcf5-481c-ab2c-6bab037f04d2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:07.141546 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b447c25e-dcf5-481c-ab2c-6bab037f04d2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:07.142745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b447c25e-dcf5-481c-ab2c-6bab037f04d2 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.159194 May 17 18:16:07.143482 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 285/562] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:06 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:07.724988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-587f6bff-8b13-4c03-8f79-8b3e422fbe1c tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:07.725686 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-587f6bff-8b13-4c03-8f79-8b3e422fbe1c tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:07.732354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-587f6bff-8b13-4c03-8f79-8b3e422fbe1c tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:07.732804 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-587f6bff-8b13-4c03-8f79-8b3e422fbe1c tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:07.733574 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-587f6bff-8b13-4c03-8f79-8b3e422fbe1c tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:07.734097 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-587f6bff-8b13-4c03-8f79-8b3e422fbe1c tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:07.867643 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-587f6bff-8b13-4c03-8f79-8b3e422fbe1c tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:07.875370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-587f6bff-8b13-4c03-8f79-8b3e422fbe1c tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.154158 May 17 18:16:07.876348 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 286/563] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:07 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:08.160803 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-66c538fd-a5c4-4ad1-94a6-011182bfba92 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:08.161431 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-66c538fd-a5c4-4ad1-94a6-011182bfba92 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:08.167677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66c538fd-a5c4-4ad1-94a6-011182bfba92 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:08.168175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66c538fd-a5c4-4ad1-94a6-011182bfba92 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:08.168951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66c538fd-a5c4-4ad1-94a6-011182bfba92 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:08.169415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-66c538fd-a5c4-4ad1-94a6-011182bfba92 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:08.302889 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-66c538fd-a5c4-4ad1-94a6-011182bfba92 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:08.312372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-66c538fd-a5c4-4ad1-94a6-011182bfba92 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:08.313993 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-66c538fd-a5c4-4ad1-94a6-011182bfba92 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:08.315190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-66c538fd-a5c4-4ad1-94a6-011182bfba92 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.158463 May 17 18:16:08.315753 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 287/564] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:08 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:08.900586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ef9804d8-2ee5-4c3a-bd9b-148c2d82b680 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:08.901300 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ef9804d8-2ee5-4c3a-bd9b-148c2d82b680 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:08.907753 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef9804d8-2ee5-4c3a-bd9b-148c2d82b680 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:08.908207 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef9804d8-2ee5-4c3a-bd9b-148c2d82b680 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:08.909321 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef9804d8-2ee5-4c3a-bd9b-148c2d82b680 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:08.909861 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ef9804d8-2ee5-4c3a-bd9b-148c2d82b680 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:09.044276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ef9804d8-2ee5-4c3a-bd9b-148c2d82b680 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:09.052035 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ef9804d8-2ee5-4c3a-bd9b-148c2d82b680 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.156117 May 17 18:16:09.052669 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 288/565] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:08 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:09.334783 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-08d147a9-571d-4a4d-a18f-5fddca3ee4bc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:09.335425 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-08d147a9-571d-4a4d-a18f-5fddca3ee4bc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:09.342484 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08d147a9-571d-4a4d-a18f-5fddca3ee4bc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:09.342974 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08d147a9-571d-4a4d-a18f-5fddca3ee4bc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:09.343752 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08d147a9-571d-4a4d-a18f-5fddca3ee4bc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:09.344188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08d147a9-571d-4a4d-a18f-5fddca3ee4bc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:09.479967 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-08d147a9-571d-4a4d-a18f-5fddca3ee4bc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:09.488885 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-08d147a9-571d-4a4d-a18f-5fddca3ee4bc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:09.490407 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-08d147a9-571d-4a4d-a18f-5fddca3ee4bc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:09.491794 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-08d147a9-571d-4a4d-a18f-5fddca3ee4bc tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.161074 May 17 18:16:09.492347 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 289/566] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:09 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:10.068908 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-41395847-574e-4705-92d5-c5227db758b7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:10.069661 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-41395847-574e-4705-92d5-c5227db758b7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:10.075876 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-41395847-574e-4705-92d5-c5227db758b7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:10.076329 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-41395847-574e-4705-92d5-c5227db758b7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:10.077224 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-41395847-574e-4705-92d5-c5227db758b7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:10.077635 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-41395847-574e-4705-92d5-c5227db758b7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:10.212171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-41395847-574e-4705-92d5-c5227db758b7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:10.219784 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-41395847-574e-4705-92d5-c5227db758b7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.155036 May 17 18:16:10.220570 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 290/567] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:10 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:10.511171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4b2dff29-8abf-4c5b-ba5b-ca8eef5b47a5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:10.511685 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4b2dff29-8abf-4c5b-ba5b-ca8eef5b47a5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:10.517930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4b2dff29-8abf-4c5b-ba5b-ca8eef5b47a5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:10.518316 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4b2dff29-8abf-4c5b-ba5b-ca8eef5b47a5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:10.519132 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4b2dff29-8abf-4c5b-ba5b-ca8eef5b47a5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:10.519575 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4b2dff29-8abf-4c5b-ba5b-ca8eef5b47a5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:10.660781 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4b2dff29-8abf-4c5b-ba5b-ca8eef5b47a5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:10.670036 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4b2dff29-8abf-4c5b-ba5b-ca8eef5b47a5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:10.671574 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4b2dff29-8abf-4c5b-ba5b-ca8eef5b47a5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:10.672749 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4b2dff29-8abf-4c5b-ba5b-ca8eef5b47a5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.165626 May 17 18:16:10.673316 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 291/568] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:10 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:11.237392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0e67144d-c1f5-42ab-b805-2e48720eb86d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:11.238070 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0e67144d-c1f5-42ab-b805-2e48720eb86d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:11.246018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e67144d-c1f5-42ab-b805-2e48720eb86d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:11.246524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e67144d-c1f5-42ab-b805-2e48720eb86d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:11.247318 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e67144d-c1f5-42ab-b805-2e48720eb86d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:11.247764 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0e67144d-c1f5-42ab-b805-2e48720eb86d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:11.387116 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0e67144d-c1f5-42ab-b805-2e48720eb86d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:11.396128 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0e67144d-c1f5-42ab-b805-2e48720eb86d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.162532 May 17 18:16:11.396933 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 292/569] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:11 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:11.691408 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-dc3b3357-aa84-491b-abfb-485096d1c6eb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:11.692044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-dc3b3357-aa84-491b-abfb-485096d1c6eb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:11.698816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc3b3357-aa84-491b-abfb-485096d1c6eb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:11.699301 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc3b3357-aa84-491b-abfb-485096d1c6eb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:11.700080 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc3b3357-aa84-491b-abfb-485096d1c6eb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:11.700516 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dc3b3357-aa84-491b-abfb-485096d1c6eb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:11.838227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-dc3b3357-aa84-491b-abfb-485096d1c6eb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:11.846924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-dc3b3357-aa84-491b-abfb-485096d1c6eb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:11.848434 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-dc3b3357-aa84-491b-abfb-485096d1c6eb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:11.849609 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-dc3b3357-aa84-491b-abfb-485096d1c6eb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.162171 May 17 18:16:11.850172 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 293/570] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:11 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:12.413605 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-35f11b91-d7a7-423a-9b0b-e9f82cb16093 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:12.414259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-35f11b91-d7a7-423a-9b0b-e9f82cb16093 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:12.420869 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35f11b91-d7a7-423a-9b0b-e9f82cb16093 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:12.421333 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35f11b91-d7a7-423a-9b0b-e9f82cb16093 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:12.422325 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35f11b91-d7a7-423a-9b0b-e9f82cb16093 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:12.422798 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35f11b91-d7a7-423a-9b0b-e9f82cb16093 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:12.550378 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-35f11b91-d7a7-423a-9b0b-e9f82cb16093 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:12.559496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-35f11b91-d7a7-423a-9b0b-e9f82cb16093 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.149884 May 17 18:16:12.560067 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 294/571] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:12 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:12.871682 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1bcb1a2d-f6d1-49b0-8b6e-647b83691dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:12.872434 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1bcb1a2d-f6d1-49b0-8b6e-647b83691dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:12.880737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1bcb1a2d-f6d1-49b0-8b6e-647b83691dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:12.881186 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1bcb1a2d-f6d1-49b0-8b6e-647b83691dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:12.881954 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1bcb1a2d-f6d1-49b0-8b6e-647b83691dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:12.882394 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1bcb1a2d-f6d1-49b0-8b6e-647b83691dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:13.020532 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1bcb1a2d-f6d1-49b0-8b6e-647b83691dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:13.029113 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1bcb1a2d-f6d1-49b0-8b6e-647b83691dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:13.030636 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-1bcb1a2d-f6d1-49b0-8b6e-647b83691dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:13.031792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1bcb1a2d-f6d1-49b0-8b6e-647b83691dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.167249 May 17 18:16:13.032353 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 295/572] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:12 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:13.576215 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5b4d7099-691f-4ae9-83e0-50a37daec2d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:13.576867 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5b4d7099-691f-4ae9-83e0-50a37daec2d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:13.584786 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b4d7099-691f-4ae9-83e0-50a37daec2d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:13.585249 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b4d7099-691f-4ae9-83e0-50a37daec2d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:13.586106 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b4d7099-691f-4ae9-83e0-50a37daec2d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:13.587397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b4d7099-691f-4ae9-83e0-50a37daec2d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:13.647025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-59d573b9-0cf3-473d-96a1-7edec3afa352 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "POST /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.875719 May 17 18:16:13.647753 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 278/573] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:16:01 2022] POST /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924/os-volume_attachments => generated 194 bytes in 11877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:13.733095 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5b4d7099-691f-4ae9-83e0-50a37daec2d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:13.740515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5b4d7099-691f-4ae9-83e0-50a37daec2d3 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.168060 May 17 18:16:13.741014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 296/574] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:13 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:14.051468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-116d7d69-d461-4e59-ba38-e9dff119f161 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:14.052224 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-116d7d69-d461-4e59-ba38-e9dff119f161 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:14.058347 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-116d7d69-d461-4e59-ba38-e9dff119f161 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:14.058844 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-116d7d69-d461-4e59-ba38-e9dff119f161 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:14.059675 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-116d7d69-d461-4e59-ba38-e9dff119f161 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:14.060115 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-116d7d69-d461-4e59-ba38-e9dff119f161 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:14.188559 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-116d7d69-d461-4e59-ba38-e9dff119f161 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:14.197587 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-116d7d69-d461-4e59-ba38-e9dff119f161 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:14.199117 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-116d7d69-d461-4e59-ba38-e9dff119f161 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:14.200277 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-116d7d69-d461-4e59-ba38-e9dff119f161 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.153637 May 17 18:16:14.200837 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 279/575] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:14 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:14.757120 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8941fe91-a2f6-46cd-93e5-bb9f06a689dd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:14.757770 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8941fe91-a2f6-46cd-93e5-bb9f06a689dd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:14.765642 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8941fe91-a2f6-46cd-93e5-bb9f06a689dd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:14.766084 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8941fe91-a2f6-46cd-93e5-bb9f06a689dd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:14.766875 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8941fe91-a2f6-46cd-93e5-bb9f06a689dd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:14.767309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8941fe91-a2f6-46cd-93e5-bb9f06a689dd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:14.893652 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8941fe91-a2f6-46cd-93e5-bb9f06a689dd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:14.901509 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8941fe91-a2f6-46cd-93e5-bb9f06a689dd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1359 microversion: 2.1 time: 0.148374 May 17 18:16:14.902071 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 297/576] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:14 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:15.218205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-93cb5fa1-2afe-4b5c-bc71-57e737725588 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:15.218861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-93cb5fa1-2afe-4b5c-bc71-57e737725588 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:15.225354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-93cb5fa1-2afe-4b5c-bc71-57e737725588 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:15.225803 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-93cb5fa1-2afe-4b5c-bc71-57e737725588 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:15.226560 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-93cb5fa1-2afe-4b5c-bc71-57e737725588 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:15.227252 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-93cb5fa1-2afe-4b5c-bc71-57e737725588 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:15.356352 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-93cb5fa1-2afe-4b5c-bc71-57e737725588 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:15.364509 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-93cb5fa1-2afe-4b5c-bc71-57e737725588 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:15.366010 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-93cb5fa1-2afe-4b5c-bc71-57e737725588 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:15.368876 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-93cb5fa1-2afe-4b5c-bc71-57e737725588 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.153753 May 17 18:16:15.369459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 280/577] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:15 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:15.918166 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e5283cf8-d7e6-42a2-96a4-84d45dc1e7c0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:15.918801 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e5283cf8-d7e6-42a2-96a4-84d45dc1e7c0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:15.925195 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5283cf8-d7e6-42a2-96a4-84d45dc1e7c0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:15.925644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5283cf8-d7e6-42a2-96a4-84d45dc1e7c0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:15.926410 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5283cf8-d7e6-42a2-96a4-84d45dc1e7c0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:15.926873 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5283cf8-d7e6-42a2-96a4-84d45dc1e7c0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:16.053896 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e5283cf8-d7e6-42a2-96a4-84d45dc1e7c0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:16.061961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e5283cf8-d7e6-42a2-96a4-84d45dc1e7c0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1548 microversion: 2.1 time: 0.148138 May 17 18:16:16.062528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 298/578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:15 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:16.078479 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e9d649ae-161a-48d1-92e0-7c34147e0a18 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:16.079397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e9d649ae-161a-48d1-92e0-7c34147e0a18 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:16.086850 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e9d649ae-161a-48d1-92e0-7c34147e0a18 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:16.087306 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e9d649ae-161a-48d1-92e0-7c34147e0a18 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:16.088072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e9d649ae-161a-48d1-92e0-7c34147e0a18 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:16.088506 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e9d649ae-161a-48d1-92e0-7c34147e0a18 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:16.219228 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e9d649ae-161a-48d1-92e0-7c34147e0a18 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:16.226434 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e9d649ae-161a-48d1-92e0-7c34147e0a18 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1548 microversion: 2.1 time: 0.152025 May 17 18:16:16.227648 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 281/579] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:16 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:16.242304 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-08e3bef9-e11c-4b2c-83ea-b76783a7b7ec tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:16.245759 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-08e3bef9-e11c-4b2c-83ea-b76783a7b7ec tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:16.246521 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-08e3bef9-e11c-4b2c-83ea-b76783a7b7ec tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Searching by: {'deleted': False, 'project_id': 'a0b25b97710c4115871b094e03709347'} {{(pid=117021) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 17 18:16:16.252989 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08e3bef9-e11c-4b2c-83ea-b76783a7b7ec tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:16.253437 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08e3bef9-e11c-4b2c-83ea-b76783a7b7ec tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:16.254232 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08e3bef9-e11c-4b2c-83ea-b76783a7b7ec tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:16.254693 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-08e3bef9-e11c-4b2c-83ea-b76783a7b7ec tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:16.342763 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.multi_cell_list [None req-08e3bef9-e11c-4b2c-83ea-b76783a7b7ec tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117021) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 17 18:16:16.387083 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fc9f1f6e-7ed3-44e9-8dd6-ef7cc57dbdac tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:16.387698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fc9f1f6e-7ed3-44e9-8dd6-ef7cc57dbdac tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:16.393604 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc9f1f6e-7ed3-44e9-8dd6-ef7cc57dbdac tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:16.394061 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc9f1f6e-7ed3-44e9-8dd6-ef7cc57dbdac tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:16.394853 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc9f1f6e-7ed3-44e9-8dd6-ef7cc57dbdac tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:16.395294 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc9f1f6e-7ed3-44e9-8dd6-ef7cc57dbdac tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:16.435351 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-08e3bef9-e11c-4b2c-83ea-b76783a7b7ec tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.196669 May 17 18:16:16.436245 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 299/580] 10.222.0.25 () {58 vars in 1124 bytes} [Tue May 17 18:16:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:16.447402 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c1d66cf5-c5d1-428f-89df-826bb5b0f559 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:16.448052 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c1d66cf5-c5d1-428f-89df-826bb5b0f559 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:16.453951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c1d66cf5-c5d1-428f-89df-826bb5b0f559 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:16.454409 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c1d66cf5-c5d1-428f-89df-826bb5b0f559 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:16.455220 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c1d66cf5-c5d1-428f-89df-826bb5b0f559 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:16.455662 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c1d66cf5-c5d1-428f-89df-826bb5b0f559 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:16.569004 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-fc9f1f6e-7ed3-44e9-8dd6-ef7cc57dbdac tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:16.578113 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-fc9f1f6e-7ed3-44e9-8dd6-ef7cc57dbdac tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:16.579643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-fc9f1f6e-7ed3-44e9-8dd6-ef7cc57dbdac tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:16.580870 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fc9f1f6e-7ed3-44e9-8dd6-ef7cc57dbdac tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.197750 May 17 18:16:16.581439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 282/581] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:16 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:16.615535 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c1d66cf5-c5d1-428f-89df-826bb5b0f559 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:16.623364 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c1d66cf5-c5d1-428f-89df-826bb5b0f559 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1548 microversion: 2.1 time: 0.180957 May 17 18:16:16.623919 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 300/582] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:16 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1548 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:17.599326 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-42bdf412-5b06-4ee7-b369-afd3564c357a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:17.599931 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-42bdf412-5b06-4ee7-b369-afd3564c357a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:17.606227 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-42bdf412-5b06-4ee7-b369-afd3564c357a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:17.606698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-42bdf412-5b06-4ee7-b369-afd3564c357a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:17.607460 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-42bdf412-5b06-4ee7-b369-afd3564c357a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:17.607890 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-42bdf412-5b06-4ee7-b369-afd3564c357a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:17.734306 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-42bdf412-5b06-4ee7-b369-afd3564c357a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:17.742469 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-42bdf412-5b06-4ee7-b369-afd3564c357a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:17.743916 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-42bdf412-5b06-4ee7-b369-afd3564c357a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:17.745315 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-42bdf412-5b06-4ee7-b369-afd3564c357a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.149619 May 17 18:16:17.745876 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 283/583] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:17 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:18.117180 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9906687f-3ca2-49a4-bec2-7bfb168613b1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d064e4c-f786-4390-8ea5-2211d7e5d873"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:18.118602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9906687f-3ca2-49a4-bec2-7bfb168613b1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:18.124936 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9906687f-3ca2-49a4-bec2-7bfb168613b1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:18.125391 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9906687f-3ca2-49a4-bec2-7bfb168613b1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:18.126163 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9906687f-3ca2-49a4-bec2-7bfb168613b1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:18.126631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9906687f-3ca2-49a4-bec2-7bfb168613b1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:18.369819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9906687f-3ca2-49a4-bec2-7bfb168613b1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "POST /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256471 May 17 18:16:18.370436 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 301/584] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:16:18 2022] POST /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:18.765320 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-53222cd4-bba2-49f0-9cb9-33b310a776ed tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:18.765932 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-53222cd4-bba2-49f0-9cb9-33b310a776ed tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:18.772267 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-53222cd4-bba2-49f0-9cb9-33b310a776ed tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:18.772725 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-53222cd4-bba2-49f0-9cb9-33b310a776ed tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:18.773493 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-53222cd4-bba2-49f0-9cb9-33b310a776ed tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:18.774454 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-53222cd4-bba2-49f0-9cb9-33b310a776ed tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:18.898530 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-53222cd4-bba2-49f0-9cb9-33b310a776ed tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:18.906989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-53222cd4-bba2-49f0-9cb9-33b310a776ed tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:18.908512 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-53222cd4-bba2-49f0-9cb9-33b310a776ed tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:18.909662 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-53222cd4-bba2-49f0-9cb9-33b310a776ed tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.148236 May 17 18:16:18.910219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 284/585] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:18 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:19.928573 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0bfa6ea8-3cf5-40a7-9e1d-c0628a3d4cd5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:19.929272 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0bfa6ea8-3cf5-40a7-9e1d-c0628a3d4cd5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:19.935562 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0bfa6ea8-3cf5-40a7-9e1d-c0628a3d4cd5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:19.936012 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0bfa6ea8-3cf5-40a7-9e1d-c0628a3d4cd5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:19.936881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0bfa6ea8-3cf5-40a7-9e1d-c0628a3d4cd5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:19.937317 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0bfa6ea8-3cf5-40a7-9e1d-c0628a3d4cd5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:20.068792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0bfa6ea8-3cf5-40a7-9e1d-c0628a3d4cd5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:20.077661 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0bfa6ea8-3cf5-40a7-9e1d-c0628a3d4cd5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:20.079218 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0bfa6ea8-3cf5-40a7-9e1d-c0628a3d4cd5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:20.080376 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0bfa6ea8-3cf5-40a7-9e1d-c0628a3d4cd5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.156516 May 17 18:16:20.080940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 302/586] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:19 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:21.099118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-377c1dec-3a86-4b55-99fb-e9014f63a0f7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:21.099731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-377c1dec-3a86-4b55-99fb-e9014f63a0f7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:21.106928 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-377c1dec-3a86-4b55-99fb-e9014f63a0f7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:21.107384 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-377c1dec-3a86-4b55-99fb-e9014f63a0f7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:21.108156 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-377c1dec-3a86-4b55-99fb-e9014f63a0f7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:21.108600 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-377c1dec-3a86-4b55-99fb-e9014f63a0f7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:21.234654 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-377c1dec-3a86-4b55-99fb-e9014f63a0f7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:21.242717 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-377c1dec-3a86-4b55-99fb-e9014f63a0f7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:21.244195 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-377c1dec-3a86-4b55-99fb-e9014f63a0f7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:21.245333 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-377c1dec-3a86-4b55-99fb-e9014f63a0f7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.150122 May 17 18:16:21.245884 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 285/587] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:21 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:22.263281 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5aeb2c11-04b3-4fc2-9a2f-231dbfe20d77 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:22.263924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5aeb2c11-04b3-4fc2-9a2f-231dbfe20d77 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:22.270309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5aeb2c11-04b3-4fc2-9a2f-231dbfe20d77 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:22.270794 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5aeb2c11-04b3-4fc2-9a2f-231dbfe20d77 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:22.271553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5aeb2c11-04b3-4fc2-9a2f-231dbfe20d77 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:22.271985 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5aeb2c11-04b3-4fc2-9a2f-231dbfe20d77 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:22.399585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5aeb2c11-04b3-4fc2-9a2f-231dbfe20d77 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:22.407628 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5aeb2c11-04b3-4fc2-9a2f-231dbfe20d77 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:22.409097 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5aeb2c11-04b3-4fc2-9a2f-231dbfe20d77 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:22.410227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5aeb2c11-04b3-4fc2-9a2f-231dbfe20d77 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.150820 May 17 18:16:22.410820 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 303/588] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:22 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:23.428734 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-90bf4b1c-ca97-4a26-b05d-f05562e36a0f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:23.429249 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-90bf4b1c-ca97-4a26-b05d-f05562e36a0f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:23.436203 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-90bf4b1c-ca97-4a26-b05d-f05562e36a0f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:23.436655 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-90bf4b1c-ca97-4a26-b05d-f05562e36a0f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:23.437415 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-90bf4b1c-ca97-4a26-b05d-f05562e36a0f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:23.437854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-90bf4b1c-ca97-4a26-b05d-f05562e36a0f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:23.563112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-90bf4b1c-ca97-4a26-b05d-f05562e36a0f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:23.572419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-90bf4b1c-ca97-4a26-b05d-f05562e36a0f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:23.573955 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-90bf4b1c-ca97-4a26-b05d-f05562e36a0f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:23.575134 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-90bf4b1c-ca97-4a26-b05d-f05562e36a0f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.150409 May 17 18:16:23.575692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 286/589] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:23 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:24.593269 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6b5bea9b-dfc0-4ab0-b052-765098651181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:24.593822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6b5bea9b-dfc0-4ab0-b052-765098651181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:24.600084 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6b5bea9b-dfc0-4ab0-b052-765098651181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:24.600530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6b5bea9b-dfc0-4ab0-b052-765098651181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:24.601281 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6b5bea9b-dfc0-4ab0-b052-765098651181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:24.601882 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6b5bea9b-dfc0-4ab0-b052-765098651181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:24.733883 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6b5bea9b-dfc0-4ab0-b052-765098651181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:24.741942 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6b5bea9b-dfc0-4ab0-b052-765098651181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:24.743448 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6b5bea9b-dfc0-4ab0-b052-765098651181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:24.744580 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6b5bea9b-dfc0-4ab0-b052-765098651181 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.155285 May 17 18:16:24.745128 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 304/590] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:24 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:25.763102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3aee66a3-7eae-4e1b-9051-756f473ae426 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:25.763728 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3aee66a3-7eae-4e1b-9051-756f473ae426 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:25.772558 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3aee66a3-7eae-4e1b-9051-756f473ae426 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:25.774838 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3aee66a3-7eae-4e1b-9051-756f473ae426 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:25.776132 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3aee66a3-7eae-4e1b-9051-756f473ae426 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:25.776830 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3aee66a3-7eae-4e1b-9051-756f473ae426 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:25.928373 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3aee66a3-7eae-4e1b-9051-756f473ae426 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:25.936912 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3aee66a3-7eae-4e1b-9051-756f473ae426 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:25.938397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3aee66a3-7eae-4e1b-9051-756f473ae426 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:25.939739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3aee66a3-7eae-4e1b-9051-756f473ae426 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.180567 May 17 18:16:25.940292 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 287/591] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:25 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:26.137545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fda4e938-3eac-4030-a22d-6d6782cfab37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:26.138092 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-fda4e938-3eac-4030-a22d-6d6782cfab37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:26.144719 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fda4e938-3eac-4030-a22d-6d6782cfab37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:26.145133 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fda4e938-3eac-4030-a22d-6d6782cfab37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:26.145942 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fda4e938-3eac-4030-a22d-6d6782cfab37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:26.146385 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fda4e938-3eac-4030-a22d-6d6782cfab37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:26.170313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-fda4e938-3eac-4030-a22d-6d6782cfab37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790/ips" status: 200 len: 149 microversion: 2.1 time: 0.037564 May 17 18:16:26.170924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 305/592] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 17 18:16:26 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:26.181461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0c3221d0-a09f-44ef-b933-521aa16f219a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aae50e3a-e469-462e-9d10-5b53213562e9"}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:26.182692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0c3221d0-a09f-44ef-b933-521aa16f219a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:26.188611 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0c3221d0-a09f-44ef-b933-521aa16f219a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:26.189057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0c3221d0-a09f-44ef-b933-521aa16f219a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:26.189817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0c3221d0-a09f-44ef-b933-521aa16f219a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:26.190250 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0c3221d0-a09f-44ef-b933-521aa16f219a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:26.266933 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-0c3221d0-a09f-44ef-b933-521aa16f219a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Invalid volume: volume aae50e3a-e469-462e-9d10-5b53213562e9 is already attached to instances: 1a4f1963-1182-4b7f-8347-100ee3382934 May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0c3221d0-a09f-44ef-b933-521aa16f219a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: POST /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790/os-volume_attachments HTTP/1.1 May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 74 May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:16:26.268799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {"volumeAttachment": {"volumeId": "aae50e3a-e469-462e-9d10-5b53213562e9"}} May 17 18:16:26.270318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Invalid volume: volume aae50e3a-e469-462e-9d10-5b53213562e9 is already attached to instances: 1a4f1963-1182-4b7f-8347-100ee3382934 May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'server_id': '1a6933d9-d646-4718-9297-741290e08790', 'body': {'volumeAttachment': {'volumeId': 'aae50e3a-e469-462e-9d10-5b53213562e9'}}} May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aae50e3a-e469-462e-9d10-5b53213562e9 is already attached to instances: 1a4f1963-1182-4b7f-8347-100ee3382934 May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:16:26.271233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aae50e3a-e469-462e-9d10-5b53213562e9 is already attached to instances: 1a4f1963-1182-4b7f-8347-100ee3382934 May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:26.272445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:16:26.274874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:16:26.274874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:16:26.274874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:16:26.274874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aae50e3a-e469-462e-9d10-5b53213562e9 is already attached to instances: 1a4f1963-1182-4b7f-8347-100ee3382934 May 17 18:16:26.274874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:16:26.274874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0c3221d0-a09f-44ef-b933-521aa16f219a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 400 to user: Invalid volume: volume aae50e3a-e469-462e-9d10-5b53213562e9 is already attached to instances: 1a4f1963-1182-4b7f-8347-100ee3382934 {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:16:26.274874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0c3221d0-a09f-44ef-b933-521aa16f219a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093397 May 17 18:16:26.274874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 288/593] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:16:26 2022] POST /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 18:16:26.280680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ea559063-7d3f-46ae-818e-5f211fcb9232 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:26.281178 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ea559063-7d3f-46ae-818e-5f211fcb9232 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:26.287033 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ea559063-7d3f-46ae-818e-5f211fcb9232 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:26.287484 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ea559063-7d3f-46ae-818e-5f211fcb9232 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:26.288261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ea559063-7d3f-46ae-818e-5f211fcb9232 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:26.288759 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ea559063-7d3f-46ae-818e-5f211fcb9232 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:26.328513 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ea559063-7d3f-46ae-818e-5f211fcb9232 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:16:26.419693 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ea559063-7d3f-46ae-818e-5f211fcb9232 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 204 len: 0 microversion: 2.1 time: 0.142369 May 17 18:16:26.422683 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 306/594] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:16:26 2022] DELETE /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:16:26.432617 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-df470078-a2f1-450c-81b3-238a62b45e37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:26.433814 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-df470078-a2f1-450c-81b3-238a62b45e37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:26.443444 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-df470078-a2f1-450c-81b3-238a62b45e37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:26.443913 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-df470078-a2f1-450c-81b3-238a62b45e37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:26.444715 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-df470078-a2f1-450c-81b3-238a62b45e37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:26.445215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-df470078-a2f1-450c-81b3-238a62b45e37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:26.584381 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-df470078-a2f1-450c-81b3-238a62b45e37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:26.591824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-df470078-a2f1-450c-81b3-238a62b45e37 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1681 microversion: 2.1 time: 0.166674 May 17 18:16:26.592387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 289/595] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:26 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:26.958790 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-23a7bb00-628c-480d-a219-c47800b2e45f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:26.959489 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-23a7bb00-628c-480d-a219-c47800b2e45f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:26.965589 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-23a7bb00-628c-480d-a219-c47800b2e45f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:26.966037 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-23a7bb00-628c-480d-a219-c47800b2e45f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:26.966827 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-23a7bb00-628c-480d-a219-c47800b2e45f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:26.967261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-23a7bb00-628c-480d-a219-c47800b2e45f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:27.098075 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-23a7bb00-628c-480d-a219-c47800b2e45f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:27.106848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-23a7bb00-628c-480d-a219-c47800b2e45f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:27.108355 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-23a7bb00-628c-480d-a219-c47800b2e45f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:27.109505 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-23a7bb00-628c-480d-a219-c47800b2e45f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.154959 May 17 18:16:27.110062 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 307/596] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:26 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:27.608260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8119526e-aa44-4dce-a301-3723ddb85807 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:27.608863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8119526e-aa44-4dce-a301-3723ddb85807 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:27.615140 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8119526e-aa44-4dce-a301-3723ddb85807 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:27.615592 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8119526e-aa44-4dce-a301-3723ddb85807 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:27.616345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8119526e-aa44-4dce-a301-3723ddb85807 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:27.616782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8119526e-aa44-4dce-a301-3723ddb85807 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:27.744157 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8119526e-aa44-4dce-a301-3723ddb85807 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:27.751435 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8119526e-aa44-4dce-a301-3723ddb85807 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1681 microversion: 2.1 time: 0.146901 May 17 18:16:27.751932 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 290/597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:27 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:28.127343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-30095dab-7ad5-4e68-acba-f5abc24e9f60 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:28.127880 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-30095dab-7ad5-4e68-acba-f5abc24e9f60 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:28.134815 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-30095dab-7ad5-4e68-acba-f5abc24e9f60 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:28.135270 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-30095dab-7ad5-4e68-acba-f5abc24e9f60 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:28.136034 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-30095dab-7ad5-4e68-acba-f5abc24e9f60 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:28.136469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-30095dab-7ad5-4e68-acba-f5abc24e9f60 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:28.263581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-30095dab-7ad5-4e68-acba-f5abc24e9f60 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:28.271619 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-30095dab-7ad5-4e68-acba-f5abc24e9f60 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:28.273109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-30095dab-7ad5-4e68-acba-f5abc24e9f60 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:28.274398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-30095dab-7ad5-4e68-acba-f5abc24e9f60 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.150937 May 17 18:16:28.275050 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 308/598] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:28 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:28.769561 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4478c706-426c-4807-be5e-484c752e3820 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:28.770209 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4478c706-426c-4807-be5e-484c752e3820 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:28.777130 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4478c706-426c-4807-be5e-484c752e3820 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:28.777575 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4478c706-426c-4807-be5e-484c752e3820 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:28.778334 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4478c706-426c-4807-be5e-484c752e3820 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:28.778797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4478c706-426c-4807-be5e-484c752e3820 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:28.904619 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4478c706-426c-4807-be5e-484c752e3820 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:28.911973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4478c706-426c-4807-be5e-484c752e3820 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1681 microversion: 2.1 time: 0.146304 May 17 18:16:28.912827 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 291/599] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:28 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:29.292335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f14fff86-7110-482c-91d8-f3654a3e5165 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:29.292942 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f14fff86-7110-482c-91d8-f3654a3e5165 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:29.299297 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f14fff86-7110-482c-91d8-f3654a3e5165 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:29.299749 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f14fff86-7110-482c-91d8-f3654a3e5165 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:29.300509 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f14fff86-7110-482c-91d8-f3654a3e5165 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:29.300941 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f14fff86-7110-482c-91d8-f3654a3e5165 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:29.426895 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f14fff86-7110-482c-91d8-f3654a3e5165 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:29.435569 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f14fff86-7110-482c-91d8-f3654a3e5165 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:29.437063 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f14fff86-7110-482c-91d8-f3654a3e5165 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:29.438205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f14fff86-7110-482c-91d8-f3654a3e5165 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.149859 May 17 18:16:29.438806 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 309/600] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:29 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:29.929431 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1ac44c25-e1e8-40e0-8a37-ab237bb3a8f9 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:29.930727 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1ac44c25-e1e8-40e0-8a37-ab237bb3a8f9 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:29.937143 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1ac44c25-e1e8-40e0-8a37-ab237bb3a8f9 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:29.937593 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1ac44c25-e1e8-40e0-8a37-ab237bb3a8f9 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:29.938353 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1ac44c25-e1e8-40e0-8a37-ab237bb3a8f9 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:29.938818 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1ac44c25-e1e8-40e0-8a37-ab237bb3a8f9 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:30.070380 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1ac44c25-e1e8-40e0-8a37-ab237bb3a8f9 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:30.078057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1ac44c25-e1e8-40e0-8a37-ab237bb3a8f9 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1681 microversion: 2.1 time: 0.152537 May 17 18:16:30.078700 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 292/601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:29 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:30.456677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-60a29e4a-77e9-4447-a9a0-c2d7bf78a085 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:30.457262 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-60a29e4a-77e9-4447-a9a0-c2d7bf78a085 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:30.463573 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-60a29e4a-77e9-4447-a9a0-c2d7bf78a085 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:30.464015 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-60a29e4a-77e9-4447-a9a0-c2d7bf78a085 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:30.464796 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-60a29e4a-77e9-4447-a9a0-c2d7bf78a085 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:30.465224 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-60a29e4a-77e9-4447-a9a0-c2d7bf78a085 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:30.597285 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-60a29e4a-77e9-4447-a9a0-c2d7bf78a085 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:30.607435 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-60a29e4a-77e9-4447-a9a0-c2d7bf78a085 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:30.608959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-60a29e4a-77e9-4447-a9a0-c2d7bf78a085 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:30.610122 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-60a29e4a-77e9-4447-a9a0-c2d7bf78a085 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.157357 May 17 18:16:30.610911 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 310/602] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:30 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:30.733452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-20f48573-9c50-46ea-8cbe-fe8335062c94 req-dd1a9738-fb5f-42fe-b51b-8ede846c1c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769abf30-807c-41f0-bd94-0809137c0155", "name": "network-vif-plugged", "status": "completed", "tag": "cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:30.743750 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-20f48573-9c50-46ea-8cbe-fe8335062c94 req-dd1a9738-fb5f-42fe-b51b-8ede846c1c5f service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:30.744232 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-20f48573-9c50-46ea-8cbe-fe8335062c94 req-dd1a9738-fb5f-42fe-b51b-8ede846c1c5f service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:30.786970 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-20f48573-9c50-46ea-8cbe-fe8335062c94 req-dd1a9738-fb5f-42fe-b51b-8ede846c1c5f service nova] Creating event network-vif-plugged:cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb for instance 769abf30-807c-41f0-bd94-0809137c0155 on hv-cinder-84130 May 17 18:16:30.797987 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-20f48573-9c50-46ea-8cbe-fe8335062c94 req-dd1a9738-fb5f-42fe-b51b-8ede846c1c5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068387 May 17 18:16:30.799048 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 293/603] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:16:31.094983 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-27ea0641-590b-429b-ace2-550c2713f925 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:31.095594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-27ea0641-590b-429b-ace2-550c2713f925 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:31.101375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-27ea0641-590b-429b-ace2-550c2713f925 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:31.101818 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-27ea0641-590b-429b-ace2-550c2713f925 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:31.102606 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-27ea0641-590b-429b-ace2-550c2713f925 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:31.103037 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-27ea0641-590b-429b-ace2-550c2713f925 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:31.232986 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-27ea0641-590b-429b-ace2-550c2713f925 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:31.240232 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-27ea0641-590b-429b-ace2-550c2713f925 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1681 microversion: 2.1 time: 0.149284 May 17 18:16:31.240986 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 311/604] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:31 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:31.629927 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d190273e-510d-4c98-b34d-4d9988db79d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:31.630684 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d190273e-510d-4c98-b34d-4d9988db79d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:31.639608 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d190273e-510d-4c98-b34d-4d9988db79d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:31.640268 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d190273e-510d-4c98-b34d-4d9988db79d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:31.641108 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d190273e-510d-4c98-b34d-4d9988db79d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:31.641740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d190273e-510d-4c98-b34d-4d9988db79d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:31.667108 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-99aa8a61-a41d-4b3b-b5d4-2854d805d191 req-3e3bca37-f89a-4ac5-94d7-6a177099c08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6933d9-d646-4718-9297-741290e08790", "name": "network-vif-deleted", "tag": "b5450332-d4eb-4a0d-8ea4-c788c95e97e0"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:31.675361 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-99aa8a61-a41d-4b3b-b5d4-2854d805d191 req-3e3bca37-f89a-4ac5-94d7-6a177099c08d service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:31.676088 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-99aa8a61-a41d-4b3b-b5d4-2854d805d191 req-3e3bca37-f89a-4ac5-94d7-6a177099c08d service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:31.690321 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-99aa8a61-a41d-4b3b-b5d4-2854d805d191 req-3e3bca37-f89a-4ac5-94d7-6a177099c08d service nova] Creating event network-vif-deleted:b5450332-d4eb-4a0d-8ea4-c788c95e97e0 for instance 1a6933d9-d646-4718-9297-741290e08790 on hv-cinder-84130 May 17 18:16:31.696274 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-99aa8a61-a41d-4b3b-b5d4-2854d805d191 req-3e3bca37-f89a-4ac5-94d7-6a177099c08d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033427 May 17 18:16:31.697533 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 312/605] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:16:31.785731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d190273e-510d-4c98-b34d-4d9988db79d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:31.794813 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d190273e-510d-4c98-b34d-4d9988db79d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:31.796378 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d190273e-510d-4c98-b34d-4d9988db79d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:31.797546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d190273e-510d-4c98-b34d-4d9988db79d1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.172787 May 17 18:16:31.798310 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 294/606] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:31 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:32.259115 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9241fc04-599f-4d43-b73c-a0d0617d458d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:32.259831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9241fc04-599f-4d43-b73c-a0d0617d458d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:32.266312 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9241fc04-599f-4d43-b73c-a0d0617d458d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:32.266802 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9241fc04-599f-4d43-b73c-a0d0617d458d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:32.267588 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9241fc04-599f-4d43-b73c-a0d0617d458d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:32.268029 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9241fc04-599f-4d43-b73c-a0d0617d458d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:32.332985 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9241fc04-599f-4d43-b73c-a0d0617d458d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:32.340524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9241fc04-599f-4d43-b73c-a0d0617d458d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1613 microversion: 2.1 time: 0.086287 May 17 18:16:32.341098 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 313/607] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:32 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:32.815185 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f8164c29-aed9-482a-9b11-52696b28ec00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:32.815797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f8164c29-aed9-482a-9b11-52696b28ec00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:32.822822 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f8164c29-aed9-482a-9b11-52696b28ec00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:32.823271 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f8164c29-aed9-482a-9b11-52696b28ec00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:32.824031 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f8164c29-aed9-482a-9b11-52696b28ec00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:32.824462 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f8164c29-aed9-482a-9b11-52696b28ec00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:32.959221 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f8164c29-aed9-482a-9b11-52696b28ec00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:32.967818 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f8164c29-aed9-482a-9b11-52696b28ec00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:32.969344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f8164c29-aed9-482a-9b11-52696b28ec00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:32.970499 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f8164c29-aed9-482a-9b11-52696b28ec00 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.159386 May 17 18:16:32.971270 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 295/608] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:32 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:33.358294 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8ee8f292-b92c-4fd2-9757-dfe4b9a7d0f5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:33.358931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8ee8f292-b92c-4fd2-9757-dfe4b9a7d0f5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:33.365314 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8ee8f292-b92c-4fd2-9757-dfe4b9a7d0f5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:33.365769 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8ee8f292-b92c-4fd2-9757-dfe4b9a7d0f5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:33.366558 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8ee8f292-b92c-4fd2-9757-dfe4b9a7d0f5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:33.368185 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8ee8f292-b92c-4fd2-9757-dfe4b9a7d0f5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:33.430310 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8ee8f292-b92c-4fd2-9757-dfe4b9a7d0f5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:33.437692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8ee8f292-b92c-4fd2-9757-dfe4b9a7d0f5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1613 microversion: 2.1 time: 0.083362 May 17 18:16:33.438266 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 314/609] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:33 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:33.990416 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7578a681-5c68-4710-bfd6-28132c3b8cad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:33.991912 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7578a681-5c68-4710-bfd6-28132c3b8cad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:33.999941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7578a681-5c68-4710-bfd6-28132c3b8cad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:34.000549 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7578a681-5c68-4710-bfd6-28132c3b8cad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:34.001466 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7578a681-5c68-4710-bfd6-28132c3b8cad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:34.001944 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7578a681-5c68-4710-bfd6-28132c3b8cad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:34.145844 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7578a681-5c68-4710-bfd6-28132c3b8cad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:34.155533 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7578a681-5c68-4710-bfd6-28132c3b8cad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:34.157036 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7578a681-5c68-4710-bfd6-28132c3b8cad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:34.158189 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7578a681-5c68-4710-bfd6-28132c3b8cad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.171965 May 17 18:16:34.158986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 296/610] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:33 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:34.454537 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:34.455354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:34.461839 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:34.462296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:34.463168 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:34.463608 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:34.493737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:34.494179 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:34.494652 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lazy-loading 'fault' on Instance uuid 1a6933d9-d646-4718-9297-741290e08790 {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:16:34.536497 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:34.544258 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d1a73f2d-ccf5-47b1-a0f6-1f11ffb96981 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 200 len: 1331 microversion: 2.1 time: 0.093604 May 17 18:16:34.544824 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 315/611] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:34 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:35.177188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-11a27881-79fb-455d-964c-cc1ff2348aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:35.177797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-11a27881-79fb-455d-964c-cc1ff2348aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:35.184647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11a27881-79fb-455d-964c-cc1ff2348aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:35.185045 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11a27881-79fb-455d-964c-cc1ff2348aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:35.185811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11a27881-79fb-455d-964c-cc1ff2348aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:35.186252 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11a27881-79fb-455d-964c-cc1ff2348aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:35.314296 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-11a27881-79fb-455d-964c-cc1ff2348aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:35.322850 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-11a27881-79fb-455d-964c-cc1ff2348aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:35.324359 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-11a27881-79fb-455d-964c-cc1ff2348aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:35.325517 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-11a27881-79fb-455d-964c-cc1ff2348aba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.152254 May 17 18:16:35.326075 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 297/612] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:35 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:35.561030 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-57b79516-5c03-475d-a1dd-47bd034546f7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:35.561644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-57b79516-5c03-475d-a1dd-47bd034546f7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:35.568156 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-57b79516-5c03-475d-a1dd-47bd034546f7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:35.568608 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-57b79516-5c03-475d-a1dd-47bd034546f7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:35.569372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-57b79516-5c03-475d-a1dd-47bd034546f7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:35.570359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-57b79516-5c03-475d-a1dd-47bd034546f7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:35.583214 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-57b79516-5c03-475d-a1dd-47bd034546f7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-57b79516-5c03-475d-a1dd-47bd034546f7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 HTTP/1.1 May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:16:35.584814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:16:35.586930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '1a6933d9-d646-4718-9297-741290e08790'} May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:16:35.587831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:16:35.589372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:16:35.590871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-57b79516-5c03-475d-a1dd-47bd034546f7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:16:35.590871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-57b79516-5c03-475d-a1dd-47bd034546f7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 404 len: 111 microversion: 2.1 time: 0.029711 May 17 18:16:35.590871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 316/613] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:35 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:16:35.595478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f613cfb0-f840-4a4b-9013-797d152a21c2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '.version_select at 0x7f74abeef790>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:35.613231 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f613cfb0-f840-4a4b-9013-797d152a21c2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-331636660" status: 202 len: 0 microversion: 2.1 time: 0.021439 May 17 18:16:35.613769 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 298/614] 10.222.0.25 () {58 vars in 1217 bytes} [Tue May 17 18:16:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-331636660 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:16:36.243426 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-15a2059a-2a91-4cbf-ade1-7784a75b372e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:36.243921 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-15a2059a-2a91-4cbf-ade1-7784a75b372e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:36.250629 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-15a2059a-2a91-4cbf-ade1-7784a75b372e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:36.251083 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-15a2059a-2a91-4cbf-ade1-7784a75b372e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:36.251921 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-15a2059a-2a91-4cbf-ade1-7784a75b372e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:36.252359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-15a2059a-2a91-4cbf-ade1-7784a75b372e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:36.355336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b0793c8e-a059-4b3c-a5c1-4855a35d6f7d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:36.356057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b0793c8e-a059-4b3c-a5c1-4855a35d6f7d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:36.363826 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b0793c8e-a059-4b3c-a5c1-4855a35d6f7d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:36.364438 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b0793c8e-a059-4b3c-a5c1-4855a35d6f7d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:36.365280 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b0793c8e-a059-4b3c-a5c1-4855a35d6f7d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:36.365792 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b0793c8e-a059-4b3c-a5c1-4855a35d6f7d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:36.398868 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-15a2059a-2a91-4cbf-ade1-7784a75b372e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lazy-loading 'services' on Instance uuid 1a4f1963-1182-4b7f-8347-100ee3382934 {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:16:36.509473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b0793c8e-a059-4b3c-a5c1-4855a35d6f7d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:36.519905 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b0793c8e-a059-4b3c-a5c1-4855a35d6f7d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:36.521747 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b0793c8e-a059-4b3c-a5c1-4855a35d6f7d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:36.523325 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b0793c8e-a059-4b3c-a5c1-4855a35d6f7d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1806 microversion: 2.20 time: 0.175931 May 17 18:16:36.524313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 299/615] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:36 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:36.535871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-15a2059a-2a91-4cbf-ade1-7784a75b372e tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-volume_attachments/aae50e3a-e469-462e-9d10-5b53213562e9" status: 202 len: 0 microversion: 2.1 time: 0.297213 May 17 18:16:36.536452 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 317/616] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:16:36 2022] DELETE /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-volume_attachments/aae50e3a-e469-462e-9d10-5b53213562e9 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:16:36.544737 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-41d72c26-cdd0-4e81-a109-c3e7d430b6ec tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:36.545664 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-41d72c26-cdd0-4e81-a109-c3e7d430b6ec tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:36.551649 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-41d72c26-cdd0-4e81-a109-c3e7d430b6ec tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:36.552111 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-41d72c26-cdd0-4e81-a109-c3e7d430b6ec tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:36.552884 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-41d72c26-cdd0-4e81-a109-c3e7d430b6ec tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:36.553324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-41d72c26-cdd0-4e81-a109-c3e7d430b6ec tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:36.586848 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-41d72c26-cdd0-4e81-a109-c3e7d430b6ec tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044823 May 17 18:16:36.587428 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 300/617] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:16:36 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:37.510833 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-141c12d6-2bc9-4f45-876d-649eb9cf65af tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:37.511535 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-141c12d6-2bc9-4f45-876d-649eb9cf65af tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:37.517628 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-141c12d6-2bc9-4f45-876d-649eb9cf65af tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:37.518079 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-141c12d6-2bc9-4f45-876d-649eb9cf65af tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:37.518890 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-141c12d6-2bc9-4f45-876d-649eb9cf65af tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:37.519328 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-141c12d6-2bc9-4f45-876d-649eb9cf65af tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:37.547570 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-56b9d860-3496-4114-91ae-281826fbc5bb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:37.548156 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-56b9d860-3496-4114-91ae-281826fbc5bb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:37.555288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56b9d860-3496-4114-91ae-281826fbc5bb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:37.555607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56b9d860-3496-4114-91ae-281826fbc5bb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:37.556364 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56b9d860-3496-4114-91ae-281826fbc5bb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:37.556797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-56b9d860-3496-4114-91ae-281826fbc5bb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:37.702372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-141c12d6-2bc9-4f45-876d-649eb9cf65af tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:37.710737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-141c12d6-2bc9-4f45-876d-649eb9cf65af tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1594 microversion: 2.1 time: 0.205067 May 17 18:16:37.711315 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 318/618] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:37 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1594 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:37.716200 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b23dc369-2110-4e08-89ca-85127ce52d05 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:37.717370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b23dc369-2110-4e08-89ca-85127ce52d05 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:37.723516 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b23dc369-2110-4e08-89ca-85127ce52d05 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:37.724194 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b23dc369-2110-4e08-89ca-85127ce52d05 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:37.725136 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b23dc369-2110-4e08-89ca-85127ce52d05 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:37.725571 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b23dc369-2110-4e08-89ca-85127ce52d05 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:37.741453 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-56b9d860-3496-4114-91ae-281826fbc5bb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:37.750892 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-56b9d860-3496-4114-91ae-281826fbc5bb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:37.759489 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-56b9d860-3496-4114-91ae-281826fbc5bb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:37.760788 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b23dc369-2110-4e08-89ca-85127ce52d05 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048147 May 17 18:16:37.761259 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-56b9d860-3496-4114-91ae-281826fbc5bb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1793 microversion: 2.20 time: 0.217381 May 17 18:16:37.761678 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 319/619] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:16:37 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:37.762444 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 301/620] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:16:37 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1793 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:16:38.262747 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a57c87d3-42e9-4605-a146-cb3078b395c7 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:38.263233 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a57c87d3-42e9-4605-a146-cb3078b395c7 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:38.269314 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57c87d3-42e9-4605-a146-cb3078b395c7 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:38.269774 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57c87d3-42e9-4605-a146-cb3078b395c7 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:38.270644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57c87d3-42e9-4605-a146-cb3078b395c7 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:38.271094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57c87d3-42e9-4605-a146-cb3078b395c7 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:38.354172 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-a57c87d3-42e9-4605-a146-cb3078b395c7 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lazy-loading 'services' on Instance uuid e7f2d805-198e-4ea9-93fe-799e701c3924 {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:16:38.425843 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a57c87d3-42e9-4605-a146-cb3078b395c7 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924/os-volume_attachments/93dbb921-9409-420a-bb6d-559a8ad5d209" status: 202 len: 0 microversion: 2.1 time: 0.166834 May 17 18:16:38.426839 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 320/621] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:16:38 2022] DELETE /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924/os-volume_attachments/93dbb921-9409-420a-bb6d-559a8ad5d209 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:16:38.774147 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-396df408-b14b-4ecb-a498-ef6d201fb568 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:38.775458 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-396df408-b14b-4ecb-a498-ef6d201fb568 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:38.782144 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-396df408-b14b-4ecb-a498-ef6d201fb568 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:38.782621 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-396df408-b14b-4ecb-a498-ef6d201fb568 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:38.783397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-396df408-b14b-4ecb-a498-ef6d201fb568 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:38.783836 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-396df408-b14b-4ecb-a498-ef6d201fb568 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:38.813278 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-396df408-b14b-4ecb-a498-ef6d201fb568 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044904 May 17 18:16:38.813841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 302/622] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:16:38 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:16:38.870876 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-685bf5c5-c7ee-4aba-b50d-aae5d7f2b137 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:38.871738 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-685bf5c5-c7ee-4aba-b50d-aae5d7f2b137 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:38.881867 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-685bf5c5-c7ee-4aba-b50d-aae5d7f2b137 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:38.882359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-685bf5c5-c7ee-4aba-b50d-aae5d7f2b137 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:38.883389 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-685bf5c5-c7ee-4aba-b50d-aae5d7f2b137 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:38.883822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-685bf5c5-c7ee-4aba-b50d-aae5d7f2b137 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:38.909820 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-685bf5c5-c7ee-4aba-b50d-aae5d7f2b137 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:16:38.985950 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-685bf5c5-c7ee-4aba-b50d-aae5d7f2b137 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 204 len: 0 microversion: 2.1 time: 0.119744 May 17 18:16:38.989614 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 321/623] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:16:38 2022] DELETE /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:16:38.995350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-62b92192-66f2-4032-969a-d49e8d3d2cd8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:38.995973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-62b92192-66f2-4032-969a-d49e8d3d2cd8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:39.002010 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-62b92192-66f2-4032-969a-d49e8d3d2cd8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:39.002469 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-62b92192-66f2-4032-969a-d49e8d3d2cd8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:39.003293 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-62b92192-66f2-4032-969a-d49e8d3d2cd8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:39.003737 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-62b92192-66f2-4032-969a-d49e8d3d2cd8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:39.137012 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-62b92192-66f2-4032-969a-d49e8d3d2cd8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:39.145001 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-62b92192-66f2-4032-969a-d49e8d3d2cd8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1680 microversion: 2.1 time: 0.154120 May 17 18:16:39.145638 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 303/624] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:38 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:39.576602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-391e8b31-e5d2-4186-a29b-0efd70af9075 req-d48953f3-6615-43c8-805f-946f2ca7e629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5792551b-b2ce-425d-9831-77b469c883c8", "tag": "a29d526a-3dbb-4880-84ae-f0ec2191f0e2"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:39.585585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-391e8b31-e5d2-4186-a29b-0efd70af9075 req-d48953f3-6615-43c8-805f-946f2ca7e629 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:39.586085 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-391e8b31-e5d2-4186-a29b-0efd70af9075 req-d48953f3-6615-43c8-805f-946f2ca7e629 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:39.600151 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-391e8b31-e5d2-4186-a29b-0efd70af9075 req-d48953f3-6615-43c8-805f-946f2ca7e629 service nova] Creating event network-changed:a29d526a-3dbb-4880-84ae-f0ec2191f0e2 for instance 5792551b-b2ce-425d-9831-77b469c883c8 on hv-cinder-84130 May 17 18:16:39.606128 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-391e8b31-e5d2-4186-a29b-0efd70af9075 req-d48953f3-6615-43c8-805f-946f2ca7e629 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033508 May 17 18:16:39.606741 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 322/625] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:40.164153 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-338ad53e-e245-4221-8447-8d07aa861eeb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:40.164881 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-338ad53e-e245-4221-8447-8d07aa861eeb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:40.171010 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-338ad53e-e245-4221-8447-8d07aa861eeb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:40.171472 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-338ad53e-e245-4221-8447-8d07aa861eeb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:40.172255 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-338ad53e-e245-4221-8447-8d07aa861eeb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:40.172695 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-338ad53e-e245-4221-8447-8d07aa861eeb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:40.326239 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-338ad53e-e245-4221-8447-8d07aa861eeb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:40.336694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-338ad53e-e245-4221-8447-8d07aa861eeb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1680 microversion: 2.1 time: 0.176237 May 17 18:16:40.343112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 304/626] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:40 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:40.518885 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d2c36812-9306-49a0-880c-d22ef8525cb1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-379291499"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:40.519505 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d2c36812-9306-49a0-880c-d22ef8525cb1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:40.526047 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2c36812-9306-49a0-880c-d22ef8525cb1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:40.526494 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2c36812-9306-49a0-880c-d22ef8525cb1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:40.527471 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2c36812-9306-49a0-880c-d22ef8525cb1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:40.527902 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2c36812-9306-49a0-880c-d22ef8525cb1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:40.701526 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.network.security_group_api [None req-d2c36812-9306-49a0-880c-d22ef8525cb1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Adding security group 4a4e1f56-a92d-40f3-b054-4b31de1b4ce3 to port a29d526a-3dbb-4880-84ae-f0ec2191f0e2 May 17 18:16:41.252102 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d2c36812-9306-49a0-880c-d22ef8525cb1 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "POST /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/action" status: 202 len: 0 microversion: 2.1 time: 0.737553 May 17 18:16:41.253251 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 323/627] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:16:40 2022] POST /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:16:41.261504 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-dda11431-2fc8-4418-9385-16ea3840a095 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:41.262747 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-dda11431-2fc8-4418-9385-16ea3840a095 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:41.269871 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dda11431-2fc8-4418-9385-16ea3840a095 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:41.270554 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dda11431-2fc8-4418-9385-16ea3840a095 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:41.271551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dda11431-2fc8-4418-9385-16ea3840a095 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:41.272143 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dda11431-2fc8-4418-9385-16ea3840a095 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:41.284644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-23980126-3217-4e4e-a333-62216a0f6c96 req-0c8d1d96-5f06-4056-8f54-818174558350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5792551b-b2ce-425d-9831-77b469c883c8", "tag": "a29d526a-3dbb-4880-84ae-f0ec2191f0e2"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:41.303640 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-23980126-3217-4e4e-a333-62216a0f6c96 req-0c8d1d96-5f06-4056-8f54-818174558350 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:41.305557 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-23980126-3217-4e4e-a333-62216a0f6c96 req-0c8d1d96-5f06-4056-8f54-818174558350 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:41.338992 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-23980126-3217-4e4e-a333-62216a0f6c96 req-0c8d1d96-5f06-4056-8f54-818174558350 service nova] Creating event network-changed:a29d526a-3dbb-4880-84ae-f0ec2191f0e2 for instance 5792551b-b2ce-425d-9831-77b469c883c8 on hv-cinder-84130 May 17 18:16:41.351460 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-23980126-3217-4e4e-a333-62216a0f6c96 req-0c8d1d96-5f06-4056-8f54-818174558350 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070551 May 17 18:16:41.358375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 324/628] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:41.365506 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-56d1a80a-8e3c-4586-8f83-e454f61f7c20 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:41.366418 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-56d1a80a-8e3c-4586-8f83-e454f61f7c20 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:41.376734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-56d1a80a-8e3c-4586-8f83-e454f61f7c20 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:41.377446 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-56d1a80a-8e3c-4586-8f83-e454f61f7c20 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:41.378489 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-56d1a80a-8e3c-4586-8f83-e454f61f7c20 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:41.379126 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-56d1a80a-8e3c-4586-8f83-e454f61f7c20 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:41.954488 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-56d1a80a-8e3c-4586-8f83-e454f61f7c20 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:41.974333 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-56d1a80a-8e3c-4586-8f83-e454f61f7c20 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1680 microversion: 2.1 time: 0.614409 May 17 18:16:41.986309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 325/629] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:41 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1680 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:41.994926 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-dda11431-2fc8-4418-9385-16ea3840a095 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:42.004147 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f165c956-9380-4e26-ba0f-4653504eeced tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:42.004587 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f165c956-9380-4e26-ba0f-4653504eeced tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:42.007344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-dda11431-2fc8-4418-9385-16ea3840a095 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1640 microversion: 2.1 time: 0.749680 May 17 18:16:42.014800 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 305/630] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:41 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1640 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:42.021971 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f165c956-9380-4e26-ba0f-4653504eeced tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:42.022431 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f165c956-9380-4e26-ba0f-4653504eeced tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:42.023856 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f165c956-9380-4e26-ba0f-4653504eeced tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:42.024301 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f165c956-9380-4e26-ba0f-4653504eeced tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:42.051142 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f165c956-9380-4e26-ba0f-4653504eeced tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:16:42.136811 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f165c956-9380-4e26-ba0f-4653504eeced tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 204 len: 0 microversion: 2.1 time: 0.148699 May 17 18:16:42.137591 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 326/631] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:16:41 2022] DELETE /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:16:42.146619 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-01f4c884-d3b5-439d-a33f-997768583402 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:42.147243 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-01f4c884-d3b5-439d-a33f-997768583402 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:42.153946 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-01f4c884-d3b5-439d-a33f-997768583402 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:42.154397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-01f4c884-d3b5-439d-a33f-997768583402 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:42.155199 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-01f4c884-d3b5-439d-a33f-997768583402 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:42.155639 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-01f4c884-d3b5-439d-a33f-997768583402 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:42.350979 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-01f4c884-d3b5-439d-a33f-997768583402 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:42.358555 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-01f4c884-d3b5-439d-a33f-997768583402 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1513 microversion: 2.1 time: 0.216238 May 17 18:16:42.359153 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 306/632] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:42 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:42.993649 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d2e0e81a-c1da-4018-88b8-9a76394e1a4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:42.994442 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d2e0e81a-c1da-4018-88b8-9a76394e1a4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:43.000689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2e0e81a-c1da-4018-88b8-9a76394e1a4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:43.001139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2e0e81a-c1da-4018-88b8-9a76394e1a4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:43.001939 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2e0e81a-c1da-4018-88b8-9a76394e1a4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:43.002374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2e0e81a-c1da-4018-88b8-9a76394e1a4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:43.064123 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d2e0e81a-c1da-4018-88b8-9a76394e1a4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:43.072229 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d2e0e81a-c1da-4018-88b8-9a76394e1a4a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1613 microversion: 2.1 time: 0.083379 May 17 18:16:43.072823 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 327/633] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:42 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:43.375046 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-46e18c3c-b26c-4788-8a03-e51680adfbb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:43.375656 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-46e18c3c-b26c-4788-8a03-e51680adfbb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:43.383076 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-46e18c3c-b26c-4788-8a03-e51680adfbb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:43.383715 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-46e18c3c-b26c-4788-8a03-e51680adfbb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:43.384499 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-46e18c3c-b26c-4788-8a03-e51680adfbb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:43.384943 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-46e18c3c-b26c-4788-8a03-e51680adfbb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:43.400835 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-5677e03f-754d-47ab-898e-008abcb59406 req-665acbab-71d4-42c7-a3b4-23048c288c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4f1963-1182-4b7f-8347-100ee3382934", "name": "network-vif-deleted", "tag": "b838f220-05d5-453b-ad0a-34c550efa484"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:43.409052 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-5677e03f-754d-47ab-898e-008abcb59406 req-665acbab-71d4-42c7-a3b4-23048c288c76 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:43.409581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-5677e03f-754d-47ab-898e-008abcb59406 req-665acbab-71d4-42c7-a3b4-23048c288c76 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:43.421421 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-5677e03f-754d-47ab-898e-008abcb59406 req-665acbab-71d4-42c7-a3b4-23048c288c76 service nova] Creating event network-vif-deleted:b838f220-05d5-453b-ad0a-34c550efa484 for instance 1a4f1963-1182-4b7f-8347-100ee3382934 on hv-cinder-84130 May 17 18:16:43.427241 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-5677e03f-754d-47ab-898e-008abcb59406 req-665acbab-71d4-42c7-a3b4-23048c288c76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030697 May 17 18:16:43.428212 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 328/634] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:43.525597 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-46e18c3c-b26c-4788-8a03-e51680adfbb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:43.533147 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-46e18c3c-b26c-4788-8a03-e51680adfbb9 tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1513 microversion: 2.1 time: 0.161888 May 17 18:16:43.533717 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 307/635] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:43 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:44.092815 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:44.093503 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:44.099625 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:44.100074 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:44.101488 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:44.101923 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:44.131860 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:44.132649 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:44.132832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lazy-loading 'fault' on Instance uuid 1a4f1963-1182-4b7f-8347-100ee3382934 {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:16:44.174885 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:44.182286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0f2698a5-cc57-4768-8eab-9ff546942608 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 200 len: 1330 microversion: 2.1 time: 0.094145 May 17 18:16:44.182921 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 329/636] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:44 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:44.550435 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-69d1f56b-5e37-48fb-9c01-cc80002fba2e tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:44.551069 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-69d1f56b-5e37-48fb-9c01-cc80002fba2e tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:44.557437 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-69d1f56b-5e37-48fb-9c01-cc80002fba2e tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:44.557886 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-69d1f56b-5e37-48fb-9c01-cc80002fba2e tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:44.558684 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-69d1f56b-5e37-48fb-9c01-cc80002fba2e tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:44.559122 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-69d1f56b-5e37-48fb-9c01-cc80002fba2e tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:44.764794 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-69d1f56b-5e37-48fb-9c01-cc80002fba2e tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7eae5aa3594459bea417a96aae7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d421fe5f96421db7d4eeedd205b462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:44.772054 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-69d1f56b-5e37-48fb-9c01-cc80002fba2e tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 200 len: 1513 microversion: 2.1 time: 0.225417 May 17 18:16:44.773114 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 308/637] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:44 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:45.199220 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3f259705-9fc8-401f-a666-f06d7548900b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:45.200319 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3f259705-9fc8-401f-a666-f06d7548900b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:45.207358 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f259705-9fc8-401f-a666-f06d7548900b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:45.207842 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f259705-9fc8-401f-a666-f06d7548900b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:45.208663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f259705-9fc8-401f-a666-f06d7548900b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:45.209102 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f259705-9fc8-401f-a666-f06d7548900b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:45.222883 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-3f259705-9fc8-401f-a666-f06d7548900b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3f259705-9fc8-401f-a666-f06d7548900b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 HTTP/1.1 May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:16:45.224515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:16:45.226837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '1a4f1963-1182-4b7f-8347-100ee3382934'} May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:16:45.227848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:16:45.229392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:16:45.231360 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3f259705-9fc8-401f-a666-f06d7548900b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:16:45.232195 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3f259705-9fc8-401f-a666-f06d7548900b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 404 len: 111 microversion: 2.1 time: 0.036862 May 17 18:16:45.232769 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 330/638] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:45 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:16:45.241116 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1bf46003-facd-4c7a-92af-6851a11997a7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '.version_select at 0x7f74abcaa550>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:45.258469 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1bf46003-facd-4c7a-92af-6851a11997a7 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530647478" status: 202 len: 0 microversion: 2.1 time: 0.021235 May 17 18:16:45.259051 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 309/639] 10.222.0.25 () {58 vars in 1217 bytes} [Tue May 17 18:16:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530647478 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:16:45.441451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-967e6851-703d-4f6c-8a88-c9fa17cbe959 req-c77754a1-5e05-405e-8968-dd6900632f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f2d805-198e-4ea9-93fe-799e701c3924", "name": "network-vif-deleted", "tag": "b0705e7f-39f9-4769-b628-04006cf4dca0"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:45.450059 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-967e6851-703d-4f6c-8a88-c9fa17cbe959 req-c77754a1-5e05-405e-8968-dd6900632f92 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:45.450611 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-967e6851-703d-4f6c-8a88-c9fa17cbe959 req-c77754a1-5e05-405e-8968-dd6900632f92 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:45.463451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-967e6851-703d-4f6c-8a88-c9fa17cbe959 req-c77754a1-5e05-405e-8968-dd6900632f92 service nova] Creating event network-vif-deleted:b0705e7f-39f9-4769-b628-04006cf4dca0 for instance e7f2d805-198e-4ea9-93fe-799e701c3924 on hv-cinder-84130 May 17 18:16:45.468254 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-967e6851-703d-4f6c-8a88-c9fa17cbe959 req-c77754a1-5e05-405e-8968-dd6900632f92 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030557 May 17 18:16:45.468836 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 331/640] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:45.790840 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8edea8f2-58d8-4668-b55b-a162be5cba6b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:45.791564 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8edea8f2-58d8-4668-b55b-a162be5cba6b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] [instance: e7f2d805-198e-4ea9-93fe-799e701c3924] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:45.797565 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8edea8f2-58d8-4668-b55b-a162be5cba6b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:45.798097 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8edea8f2-58d8-4668-b55b-a162be5cba6b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:45.798896 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8edea8f2-58d8-4668-b55b-a162be5cba6b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:45.799340 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8edea8f2-58d8-4668-b55b-a162be5cba6b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:45.813407 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-8edea8f2-58d8-4668-b55b-a162be5cba6b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] HTTP exception thrown: Instance e7f2d805-198e-4ea9-93fe-799e701c3924 could not be found. May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8edea8f2-58d8-4668-b55b-a162be5cba6b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Request method failure captured: May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 HTTP/1.1 May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-XauW4yz2ALvwreTLSIoWo_1KdDeipqYgqvntl_xcWXUSMUIVh-fWIRlbkHAIlwKX8T0NGz6CZQwrteBpG5rvxMuGxjhVklVZcKzL38BqG8DQ9B-Ni6ELco0fCVMkKWVs9inNaYNq38q3Z6Y2ZVEwtuI19cfabQc6ZM2MO1LescWzc May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 76d421fe5f96421db7d4eeedd205b462 May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1362036592 May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:16:45.815125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76d421fe5f96421db7d4eeedd205b462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76d421fe5f96421db7d4eeedd205b462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76d421fe5f96421db7d4eeedd205b462"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76d421fe5f96421db7d4eeedd205b462", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-VolumesSnapshotTestJSON-1362036592 May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 76d421fe5f96421db7d4eeedd205b462 May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1362036592 May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-VolumesSnapshotTestJSON-1362036592-project May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: fc7eae5aa3594459bea417a96aae7d8d May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-VolumesSnapshotTestJSON-1362036592-project May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance e7f2d805-198e-4ea9-93fe-799e701c3924 could not be found. May 17 18:16:45.816427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': 'e7f2d805-198e-4ea9-93fe-799e701c3924'} May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7f2d805-198e-4ea9-93fe-799e701c3924 could not be found. May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:16:45.817146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7f2d805-198e-4ea9-93fe-799e701c3924 could not be found. May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f2d805-198e-4ea9-93fe-799e701c3924 could not be found. May 17 18:16:45.818698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:16:45.819812 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8edea8f2-58d8-4668-b55b-a162be5cba6b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] Returning 404 to user: Instance e7f2d805-198e-4ea9-93fe-799e701c3924 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:16:45.819812 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8edea8f2-58d8-4668-b55b-a162be5cba6b tempest-VolumesSnapshotTestJSON-1362036592 tempest-VolumesSnapshotTestJSON-1362036592-project] 10.222.0.25 "GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924" status: 404 len: 111 microversion: 2.1 time: 0.031228 May 17 18:16:45.820344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 310/641] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:45 2022] GET /compute/v2.1/servers/e7f2d805-198e-4ea9-93fe-799e701c3924 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:16:45.856651 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f4bf41ac-c1de-4fdd-abe2-d48ffc75f848 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: .version_select at 0x7f74bcf8b1f0>, body: {"keypair": {"name": "tempest-keypair-2061793064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKea0dR1i+LmQbPa3+esrD4EbTu9sgeatRm50GuzRsr6zaK1+yZBxSxB9qgy+8owqu4jgXE0baNzKG6UABQqGqQ5dkxdxZwBQj3aRpZbWkExwlxO86ImUurGSoQ9A8nl/Q=="}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:45.870026 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-f4bf41ac-c1de-4fdd-abe2-d48ffc75f848 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:16:45.873901 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-f4bf41ac-c1de-4fdd-abe2-d48ffc75f848 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for user c7b641ce301a4b7685f0f70d7ac4a5d3 and project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:16:45.896198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f4bf41ac-c1de-4fdd-abe2-d48ffc75f848 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043715 May 17 18:16:45.896792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 332/642] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 17 18:16:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:47.173867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-619795330", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc022e51-2bed-4b09-b828-c8708bb8de4d"}], "security_groups": [{"name": "tempest-securitygroup--108190973"}], "key_name": "tempest-keypair-2061793064", "user_data": "}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:47.281269 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] validate_networks() for [('bc022e51-2bed-4b09-b828-c8708bb8de4d', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:16:47.644848 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:16:47.645273 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:16:47.645751 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:16:47.646160 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:16:47.646591 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:16:47.655775 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:47.656228 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:47.657028 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:47.657465 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:47.673529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:16:47.677473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for user c7b641ce301a4b7685f0f70d7ac4a5d3 and project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:16:47.688642 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:16:47.690915 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:16:47.737349 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-454f1915-3c4e-4b8f-9079-93dcd8a41526 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.568026 May 17 18:16:47.738172 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 311/643] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:16:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:16:47.748725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0a8e43bb-25fa-461a-b31d-9fefb668d1c0 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:47.749443 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0a8e43bb-25fa-461a-b31d-9fefb668d1c0 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:47.801686 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0a8e43bb-25fa-461a-b31d-9fefb668d1c0 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:47.809302 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0a8e43bb-25fa-461a-b31d-9fefb668d1c0 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1241 microversion: 2.1 time: 0.064837 May 17 18:16:47.809889 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 333/644] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:47 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:48.826982 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1e1b1ed5-bd6c-459c-990e-bcf55e324719 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:48.827595 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1e1b1ed5-bd6c-459c-990e-bcf55e324719 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:48.834174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1e1b1ed5-bd6c-459c-990e-bcf55e324719 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:48.834656 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1e1b1ed5-bd6c-459c-990e-bcf55e324719 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:48.836058 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1e1b1ed5-bd6c-459c-990e-bcf55e324719 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:48.836519 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1e1b1ed5-bd6c-459c-990e-bcf55e324719 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:48.896035 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1e1b1ed5-bd6c-459c-990e-bcf55e324719 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:48.903774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1e1b1ed5-bd6c-459c-990e-bcf55e324719 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1245 microversion: 2.1 time: 0.081181 May 17 18:16:48.904328 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 312/645] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:48 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:49.548237 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c937cd45-1903-413a-8639-0ee55a7ec16b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32bacdf1-a92f-4167-a3ae-c052d1de4843"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:49.549290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c937cd45-1903-413a-8639-0ee55a7ec16b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:49.556563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c937cd45-1903-413a-8639-0ee55a7ec16b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:49.557013 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c937cd45-1903-413a-8639-0ee55a7ec16b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:49.557780 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c937cd45-1903-413a-8639-0ee55a7ec16b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:49.558216 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c937cd45-1903-413a-8639-0ee55a7ec16b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:49.920338 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3b18c6d2-064e-42d5-bff0-1f8b9b05e93a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:49.920967 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3b18c6d2-064e-42d5-bff0-1f8b9b05e93a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:49.927536 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3b18c6d2-064e-42d5-bff0-1f8b9b05e93a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:49.927987 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3b18c6d2-064e-42d5-bff0-1f8b9b05e93a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:49.929392 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3b18c6d2-064e-42d5-bff0-1f8b9b05e93a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:49.929836 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3b18c6d2-064e-42d5-bff0-1f8b9b05e93a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:49.994337 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3b18c6d2-064e-42d5-bff0-1f8b9b05e93a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:50.001798 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3b18c6d2-064e-42d5-bff0-1f8b9b05e93a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1237 microversion: 2.1 time: 0.085387 May 17 18:16:50.002355 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 313/646] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:49 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:50.380949 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c937cd45-1903-413a-8639-0ee55a7ec16b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.836537 May 17 18:16:50.381561 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 334/647] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:16:49 2022] POST /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:50.491265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5bae3fad-d827-4638-aa1e-8e8e0dfe409d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:50.492427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5bae3fad-d827-4638-aa1e-8e8e0dfe409d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:50.498344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5bae3fad-d827-4638-aa1e-8e8e0dfe409d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:50.498835 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5bae3fad-d827-4638-aa1e-8e8e0dfe409d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:50.499596 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5bae3fad-d827-4638-aa1e-8e8e0dfe409d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:50.500030 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5bae3fad-d827-4638-aa1e-8e8e0dfe409d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:50.577474 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-5bae3fad-d827-4638-aa1e-8e8e0dfe409d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lazy-loading 'services' on Instance uuid dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:16:50.652526 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5bae3fad-d827-4638-aa1e-8e8e0dfe409d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/os-volume_attachments/6e7af98d-cebc-41b5-af99-7f078acd2119" status: 202 len: 0 microversion: 2.1 time: 0.165284 May 17 18:16:50.653107 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 314/648] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:16:50 2022] DELETE /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/os-volume_attachments/6e7af98d-cebc-41b5-af99-7f078acd2119 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:16:51.018494 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-44eb13c7-8fca-442f-ae01-86c2702804bc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:51.019227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-44eb13c7-8fca-442f-ae01-86c2702804bc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:51.026554 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-44eb13c7-8fca-442f-ae01-86c2702804bc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:51.027037 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-44eb13c7-8fca-442f-ae01-86c2702804bc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:51.027824 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-44eb13c7-8fca-442f-ae01-86c2702804bc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:51.028265 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-44eb13c7-8fca-442f-ae01-86c2702804bc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:51.107839 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-44eb13c7-8fca-442f-ae01-86c2702804bc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:51.115732 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-44eb13c7-8fca-442f-ae01-86c2702804bc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1299 microversion: 2.1 time: 0.101337 May 17 18:16:51.116360 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 335/649] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:51 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:52.134848 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7d0b18ef-3558-46d1-8a81-2ec330798307 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:52.135673 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7d0b18ef-3558-46d1-8a81-2ec330798307 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:52.141864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7d0b18ef-3558-46d1-8a81-2ec330798307 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:52.142397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7d0b18ef-3558-46d1-8a81-2ec330798307 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:52.143475 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7d0b18ef-3558-46d1-8a81-2ec330798307 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:52.144138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7d0b18ef-3558-46d1-8a81-2ec330798307 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:52.360223 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7d0b18ef-3558-46d1-8a81-2ec330798307 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:52.369565 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7d0b18ef-3558-46d1-8a81-2ec330798307 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1366 microversion: 2.1 time: 0.240122 May 17 18:16:52.370546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 315/650] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:52 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:52.560138 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-1246de1d-375a-4df2-a1e3-074bf8f30589 req-4ba0f88f-b7a5-431e-9b42-9b1b2c8f0fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4705dd-6079-47f8-9525-79f5ae7b678b", "tag": "31820f25-c56a-4bd2-a9a0-28fc3bd82bb2"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:52.574256 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-1246de1d-375a-4df2-a1e3-074bf8f30589 req-4ba0f88f-b7a5-431e-9b42-9b1b2c8f0fa0 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:52.574805 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-1246de1d-375a-4df2-a1e3-074bf8f30589 req-4ba0f88f-b7a5-431e-9b42-9b1b2c8f0fa0 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:52.587198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-1246de1d-375a-4df2-a1e3-074bf8f30589 req-4ba0f88f-b7a5-431e-9b42-9b1b2c8f0fa0 service nova] Creating event network-changed:31820f25-c56a-4bd2-a9a0-28fc3bd82bb2 for instance 7e4705dd-6079-47f8-9525-79f5ae7b678b on hv-cinder-84130 May 17 18:16:52.592924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-1246de1d-375a-4df2-a1e3-074bf8f30589 req-4ba0f88f-b7a5-431e-9b42-9b1b2c8f0fa0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035645 May 17 18:16:52.595366 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 336/651] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:16:53.386515 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6049b2be-3734-4f52-a191-dea8bbaadf0d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:53.387162 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6049b2be-3734-4f52-a191-dea8bbaadf0d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:53.393548 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6049b2be-3734-4f52-a191-dea8bbaadf0d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:53.394006 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6049b2be-3734-4f52-a191-dea8bbaadf0d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:53.394882 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6049b2be-3734-4f52-a191-dea8bbaadf0d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:53.395329 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6049b2be-3734-4f52-a191-dea8bbaadf0d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:53.528118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6049b2be-3734-4f52-a191-dea8bbaadf0d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:53.535608 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6049b2be-3734-4f52-a191-dea8bbaadf0d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1366 microversion: 2.1 time: 0.152931 May 17 18:16:53.536173 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 316/652] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:53 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:54.555439 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-814e2e10-ee04-41ae-a533-ddd9306e0752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:54.556185 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-814e2e10-ee04-41ae-a533-ddd9306e0752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:54.562196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-814e2e10-ee04-41ae-a533-ddd9306e0752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:54.562690 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-814e2e10-ee04-41ae-a533-ddd9306e0752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:54.563467 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-814e2e10-ee04-41ae-a533-ddd9306e0752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:54.563912 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-814e2e10-ee04-41ae-a533-ddd9306e0752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:54.693812 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-814e2e10-ee04-41ae-a533-ddd9306e0752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:54.701585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-814e2e10-ee04-41ae-a533-ddd9306e0752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1366 microversion: 2.1 time: 0.153069 May 17 18:16:54.702152 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 337/653] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:54 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:55.718088 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8f3ab98e-7abd-445e-8051-9b28e77691f6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:55.718737 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8f3ab98e-7abd-445e-8051-9b28e77691f6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:55.725070 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8f3ab98e-7abd-445e-8051-9b28e77691f6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:55.725808 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8f3ab98e-7abd-445e-8051-9b28e77691f6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:55.726593 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8f3ab98e-7abd-445e-8051-9b28e77691f6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:55.727038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8f3ab98e-7abd-445e-8051-9b28e77691f6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:55.856005 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8f3ab98e-7abd-445e-8051-9b28e77691f6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:55.863228 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8f3ab98e-7abd-445e-8051-9b28e77691f6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1366 microversion: 2.1 time: 0.148988 May 17 18:16:55.863795 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 317/654] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:55 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:16:56.879656 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-df0dde3b-0285-4e46-b07c-17754d555924 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:56.880270 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-df0dde3b-0285-4e46-b07c-17754d555924 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:56.887208 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df0dde3b-0285-4e46-b07c-17754d555924 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:56.887658 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df0dde3b-0285-4e46-b07c-17754d555924 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:56.888435 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df0dde3b-0285-4e46-b07c-17754d555924 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:56.888871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df0dde3b-0285-4e46-b07c-17754d555924 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:57.023793 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-df0dde3b-0285-4e46-b07c-17754d555924 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:57.031092 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-df0dde3b-0285-4e46-b07c-17754d555924 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1366 microversion: 2.1 time: 0.155202 May 17 18:16:57.031753 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 338/655] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:56 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:58.048544 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a2c3f6fc-8395-45f9-8166-9fcd916aa57a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:58.049080 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a2c3f6fc-8395-45f9-8166-9fcd916aa57a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:58.055581 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a2c3f6fc-8395-45f9-8166-9fcd916aa57a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:58.056046 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a2c3f6fc-8395-45f9-8166-9fcd916aa57a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:58.056820 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a2c3f6fc-8395-45f9-8166-9fcd916aa57a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:58.057264 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a2c3f6fc-8395-45f9-8166-9fcd916aa57a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:58.184708 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a2c3f6fc-8395-45f9-8166-9fcd916aa57a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:58.191938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a2c3f6fc-8395-45f9-8166-9fcd916aa57a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1366 microversion: 2.1 time: 0.147341 May 17 18:16:58.192760 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 318/656] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:58 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:59.209140 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6a2ae167-9f76-40a0-b1d5-0e6b3dfd8c52 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:16:59.210109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6a2ae167-9f76-40a0-b1d5-0e6b3dfd8c52 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:59.216073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6a2ae167-9f76-40a0-b1d5-0e6b3dfd8c52 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:59.216525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6a2ae167-9f76-40a0-b1d5-0e6b3dfd8c52 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:59.217285 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6a2ae167-9f76-40a0-b1d5-0e6b3dfd8c52 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:59.217714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6a2ae167-9f76-40a0-b1d5-0e6b3dfd8c52 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:59.347507 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6a2ae167-9f76-40a0-b1d5-0e6b3dfd8c52 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:16:59.354838 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6a2ae167-9f76-40a0-b1d5-0e6b3dfd8c52 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1366 microversion: 2.1 time: 0.149515 May 17 18:16:59.355403 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 339/657] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:16:59 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:16:59.980578 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-80fa3f2f-7c54-4476-ae34-96d15edd7be0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:16:59.982154 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-80fa3f2f-7c54-4476-ae34-96d15edd7be0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:16:59.988854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-80fa3f2f-7c54-4476-ae34-96d15edd7be0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:59.989307 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-80fa3f2f-7c54-4476-ae34-96d15edd7be0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:59.990084 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-80fa3f2f-7c54-4476-ae34-96d15edd7be0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:59.990526 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-80fa3f2f-7c54-4476-ae34-96d15edd7be0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:00.019319 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-80fa3f2f-7c54-4476-ae34-96d15edd7be0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lazy-loading 'flavor' on Instance uuid 1966aa90-f5e3-4591-8105-69f6cc0fbdfb {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:17:00.151352 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-80fa3f2f-7c54-4476-ae34-96d15edd7be0 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/action" status: 200 len: 32 microversion: 2.1 time: 0.175241 May 17 18:17:00.151967 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 319/658] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:16:59 2022] POST /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:17:00.160868 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b3fcbc48-b2cd-4b58-8e97-90edeaf5867e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:00.161466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b3fcbc48-b2cd-4b58-8e97-90edeaf5867e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:00.169288 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b3fcbc48-b2cd-4b58-8e97-90edeaf5867e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:00.169737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b3fcbc48-b2cd-4b58-8e97-90edeaf5867e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:00.171874 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b3fcbc48-b2cd-4b58-8e97-90edeaf5867e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:00.171874 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b3fcbc48-b2cd-4b58-8e97-90edeaf5867e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:00.372527 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7393fa84-3e88-4664-a22f-0d257291de34 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:00.373157 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7393fa84-3e88-4664-a22f-0d257291de34 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:00.380314 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7393fa84-3e88-4664-a22f-0d257291de34 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:00.381704 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7393fa84-3e88-4664-a22f-0d257291de34 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:00.382886 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7393fa84-3e88-4664-a22f-0d257291de34 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:00.383577 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7393fa84-3e88-4664-a22f-0d257291de34 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:00.408574 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b3fcbc48-b2cd-4b58-8e97-90edeaf5867e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:00.432037 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b3fcbc48-b2cd-4b58-8e97-90edeaf5867e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.274957 May 17 18:17:00.432644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 340/659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:00 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:00.557113 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7393fa84-3e88-4664-a22f-0d257291de34 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:00.564478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7393fa84-3e88-4664-a22f-0d257291de34 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1366 microversion: 2.1 time: 0.196312 May 17 18:17:00.565047 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 320/660] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:00 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:00.790111 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-0e389c99-0400-4f6a-bcf6-a18b485d0fe9 req-60fffc63-d90a-4cca-9f92-558e0ccda3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4705dd-6079-47f8-9525-79f5ae7b678b", "name": "network-vif-plugged", "status": "completed", "tag": "31820f25-c56a-4bd2-a9a0-28fc3bd82bb2"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:00.798459 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-0e389c99-0400-4f6a-bcf6-a18b485d0fe9 req-60fffc63-d90a-4cca-9f92-558e0ccda3ef service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:00.798934 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-0e389c99-0400-4f6a-bcf6-a18b485d0fe9 req-60fffc63-d90a-4cca-9f92-558e0ccda3ef service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:00.810495 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-0e389c99-0400-4f6a-bcf6-a18b485d0fe9 req-60fffc63-d90a-4cca-9f92-558e0ccda3ef service nova] Creating event network-vif-plugged:31820f25-c56a-4bd2-a9a0-28fc3bd82bb2 for instance 7e4705dd-6079-47f8-9525-79f5ae7b678b on hv-cinder-84130 May 17 18:17:00.815479 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-0e389c99-0400-4f6a-bcf6-a18b485d0fe9 req-60fffc63-d90a-4cca-9f92-558e0ccda3ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029579 May 17 18:17:00.816378 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 341/661] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:17:01.294514 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9d5a5148-5619-4bb5-9619-8f4a525f18a9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:01.301288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9d5a5148-5619-4bb5-9619-8f4a525f18a9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:01.301739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9d5a5148-5619-4bb5-9619-8f4a525f18a9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:01.330563 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9d5a5148-5619-4bb5-9619-8f4a525f18a9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Going to try to stop instance {{(pid=117020) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 18:17:01.378377 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9d5a5148-5619-4bb5-9619-8f4a525f18a9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/action" status: 202 len: 0 microversion: 2.1 time: 0.087294 May 17 18:17:01.379056 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 321/662] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:17:01 2022] POST /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:17:01.388763 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8d92556b-574e-4412-9108-ceaad2362be8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:01.389466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8d92556b-574e-4412-9108-ceaad2362be8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:01.395678 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8d92556b-574e-4412-9108-ceaad2362be8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:01.396260 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8d92556b-574e-4412-9108-ceaad2362be8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:01.397298 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8d92556b-574e-4412-9108-ceaad2362be8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:01.397822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8d92556b-574e-4412-9108-ceaad2362be8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:01.451547 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a34274ce-4177-4e91-bbef-c7875528b374 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:01.452237 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a34274ce-4177-4e91-bbef-c7875528b374 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:01.458817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a34274ce-4177-4e91-bbef-c7875528b374 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:01.459279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a34274ce-4177-4e91-bbef-c7875528b374 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:01.460385 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a34274ce-4177-4e91-bbef-c7875528b374 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:01.460831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a34274ce-4177-4e91-bbef-c7875528b374 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:01.566676 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8d92556b-574e-4412-9108-ceaad2362be8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:01.575386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8d92556b-574e-4412-9108-ceaad2362be8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1680 microversion: 2.1 time: 0.191352 May 17 18:17:01.576307 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 342/663] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:01 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:01.581018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c6d21d2e-dadd-4eb5-bf03-95a2149ee1dd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:01.581744 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c6d21d2e-dadd-4eb5-bf03-95a2149ee1dd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:01.588390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c6d21d2e-dadd-4eb5-bf03-95a2149ee1dd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:01.588855 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c6d21d2e-dadd-4eb5-bf03-95a2149ee1dd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:01.589604 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c6d21d2e-dadd-4eb5-bf03-95a2149ee1dd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:01.590039 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c6d21d2e-dadd-4eb5-bf03-95a2149ee1dd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:01.609325 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a34274ce-4177-4e91-bbef-c7875528b374 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:01.617686 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a34274ce-4177-4e91-bbef-c7875528b374 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.171334 May 17 18:17:01.618260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 322/664] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:01 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:01.715889 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c6d21d2e-dadd-4eb5-bf03-95a2149ee1dd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:01.723377 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c6d21d2e-dadd-4eb5-bf03-95a2149ee1dd tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1366 microversion: 2.1 time: 0.146096 May 17 18:17:01.723938 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 343/665] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:01 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:02.592874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c5bcb6bc-2c1b-4eb7-b993-cfc3777f56e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:02.593493 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c5bcb6bc-2c1b-4eb7-b993-cfc3777f56e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:02.599714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5bcb6bc-2c1b-4eb7-b993-cfc3777f56e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:02.600247 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5bcb6bc-2c1b-4eb7-b993-cfc3777f56e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:02.601015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5bcb6bc-2c1b-4eb7-b993-cfc3777f56e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:02.601454 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5bcb6bc-2c1b-4eb7-b993-cfc3777f56e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:02.635286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5593de9e-6c26-4dc7-b443-796a4ad5d7d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:02.636019 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5593de9e-6c26-4dc7-b443-796a4ad5d7d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:02.642896 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5593de9e-6c26-4dc7-b443-796a4ad5d7d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:02.643343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5593de9e-6c26-4dc7-b443-796a4ad5d7d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:02.644116 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5593de9e-6c26-4dc7-b443-796a4ad5d7d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:02.644550 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5593de9e-6c26-4dc7-b443-796a4ad5d7d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:02.769054 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c5bcb6bc-2c1b-4eb7-b993-cfc3777f56e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:02.776497 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c5bcb6bc-2c1b-4eb7-b993-cfc3777f56e5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1680 microversion: 2.1 time: 0.187492 May 17 18:17:02.777074 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 323/666] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:02 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:02.788408 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7f5c0228-41e2-43ab-9cde-f4aca64619a2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:02.789100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7f5c0228-41e2-43ab-9cde-f4aca64619a2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:02.794936 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7f5c0228-41e2-43ab-9cde-f4aca64619a2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:02.795391 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7f5c0228-41e2-43ab-9cde-f4aca64619a2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:02.796156 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7f5c0228-41e2-43ab-9cde-f4aca64619a2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:02.796595 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7f5c0228-41e2-43ab-9cde-f4aca64619a2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:02.802607 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5593de9e-6c26-4dc7-b443-796a4ad5d7d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:02.810920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5593de9e-6c26-4dc7-b443-796a4ad5d7d3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.180108 May 17 18:17:02.811482 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 344/667] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:02 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:02.921392 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7f5c0228-41e2-43ab-9cde-f4aca64619a2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:02.929253 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7f5c0228-41e2-43ab-9cde-f4aca64619a2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1366 microversion: 2.1 time: 0.144509 May 17 18:17:02.929820 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 324/668] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:02 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:03.794280 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c91376b9-32c5-46db-aafd-666cba54774c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:03.794882 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c91376b9-32c5-46db-aafd-666cba54774c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:03.801186 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c91376b9-32c5-46db-aafd-666cba54774c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:03.801637 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c91376b9-32c5-46db-aafd-666cba54774c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:03.802391 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c91376b9-32c5-46db-aafd-666cba54774c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:03.802848 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c91376b9-32c5-46db-aafd-666cba54774c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:03.828564 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6dda2121-7161-4535-9f37-6abb23d09273 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:03.829177 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6dda2121-7161-4535-9f37-6abb23d09273 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:03.836246 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6dda2121-7161-4535-9f37-6abb23d09273 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:03.836730 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6dda2121-7161-4535-9f37-6abb23d09273 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:03.837508 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6dda2121-7161-4535-9f37-6abb23d09273 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:03.837949 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6dda2121-7161-4535-9f37-6abb23d09273 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:03.979838 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c91376b9-32c5-46db-aafd-666cba54774c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:03.987209 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c91376b9-32c5-46db-aafd-666cba54774c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1680 microversion: 2.1 time: 0.196856 May 17 18:17:03.987814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 345/669] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:03 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:03.992352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f4fdc4e4-e800-4488-bfcd-db15f63def4b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:03.993129 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f4fdc4e4-e800-4488-bfcd-db15f63def4b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:03.998963 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f4fdc4e4-e800-4488-bfcd-db15f63def4b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:03.999415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f4fdc4e4-e800-4488-bfcd-db15f63def4b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:04.000190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f4fdc4e4-e800-4488-bfcd-db15f63def4b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:04.000632 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f4fdc4e4-e800-4488-bfcd-db15f63def4b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:04.005904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6dda2121-7161-4535-9f37-6abb23d09273 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:04.014172 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6dda2121-7161-4535-9f37-6abb23d09273 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.189381 May 17 18:17:04.014756 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 325/670] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:03 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:04.135092 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f4fdc4e4-e800-4488-bfcd-db15f63def4b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:04.142291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f4fdc4e4-e800-4488-bfcd-db15f63def4b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1556 microversion: 2.1 time: 0.153562 May 17 18:17:04.142885 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 346/671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:03 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:04.159309 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6ae0d6f6-5dbd-4d35-8c95-95ffd2ad5037 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:04.159832 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6ae0d6f6-5dbd-4d35-8c95-95ffd2ad5037 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:04.165917 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6ae0d6f6-5dbd-4d35-8c95-95ffd2ad5037 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:04.166376 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6ae0d6f6-5dbd-4d35-8c95-95ffd2ad5037 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:04.167194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6ae0d6f6-5dbd-4d35-8c95-95ffd2ad5037 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:04.167624 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6ae0d6f6-5dbd-4d35-8c95-95ffd2ad5037 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:04.243373 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6ae0d6f6-5dbd-4d35-8c95-95ffd2ad5037 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087810 May 17 18:17:04.243963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 326/672] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 17 18:17:04 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:05.004309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4e53f7d3-ff08-4862-80e6-17d8f108abc7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:05.004982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4e53f7d3-ff08-4862-80e6-17d8f108abc7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:05.011698 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4e53f7d3-ff08-4862-80e6-17d8f108abc7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:05.012146 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4e53f7d3-ff08-4862-80e6-17d8f108abc7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:05.012924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4e53f7d3-ff08-4862-80e6-17d8f108abc7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:05.013357 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4e53f7d3-ff08-4862-80e6-17d8f108abc7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:05.032419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9caa75db-554e-4b65-9855-ad8b4a3a791e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:05.033036 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9caa75db-554e-4b65-9855-ad8b4a3a791e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:05.040746 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9caa75db-554e-4b65-9855-ad8b4a3a791e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:05.041210 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9caa75db-554e-4b65-9855-ad8b4a3a791e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:05.042218 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9caa75db-554e-4b65-9855-ad8b4a3a791e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:05.042697 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9caa75db-554e-4b65-9855-ad8b4a3a791e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:05.534906 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4e53f7d3-ff08-4862-80e6-17d8f108abc7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:05.548889 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4e53f7d3-ff08-4862-80e6-17d8f108abc7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1680 microversion: 2.1 time: 0.546801 May 17 18:17:05.558649 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 347/673] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:04 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1680 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:05.563802 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-aa752130-5601-4859-8e0c-e2eba12bad1e req-893e5297-d6ea-4d14-840a-05c2ea632dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4705dd-6079-47f8-9525-79f5ae7b678b", "tag": "31820f25-c56a-4bd2-a9a0-28fc3bd82bb2"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:05.567892 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9caa75db-554e-4b65-9855-ad8b4a3a791e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:05.576519 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-aa752130-5601-4859-8e0c-e2eba12bad1e req-893e5297-d6ea-4d14-840a-05c2ea632dcf service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:05.577173 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-aa752130-5601-4859-8e0c-e2eba12bad1e req-893e5297-d6ea-4d14-840a-05c2ea632dcf service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:05.580065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9caa75db-554e-4b65-9855-ad8b4a3a791e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.552066 May 17 18:17:05.580845 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 327/674] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:05 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:05.602911 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-aa752130-5601-4859-8e0c-e2eba12bad1e req-893e5297-d6ea-4d14-840a-05c2ea632dcf service nova] Creating event network-changed:31820f25-c56a-4bd2-a9a0-28fc3bd82bb2 for instance 7e4705dd-6079-47f8-9525-79f5ae7b678b on hv-cinder-84130 May 17 18:17:05.608849 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-aa752130-5601-4859-8e0c-e2eba12bad1e req-893e5297-d6ea-4d14-840a-05c2ea632dcf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048853 May 17 18:17:05.609604 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 348/675] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:06.564412 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9ea17804-de79-4f65-8dbb-9a510dd03968 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:06.565024 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9ea17804-de79-4f65-8dbb-9a510dd03968 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:06.572732 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ea17804-de79-4f65-8dbb-9a510dd03968 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:06.573179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ea17804-de79-4f65-8dbb-9a510dd03968 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:06.573934 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ea17804-de79-4f65-8dbb-9a510dd03968 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:06.574370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ea17804-de79-4f65-8dbb-9a510dd03968 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:06.599969 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-801731be-0e71-47ec-b4b2-a8c9b5ba39eb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:06.600841 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-801731be-0e71-47ec-b4b2-a8c9b5ba39eb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:06.607017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-801731be-0e71-47ec-b4b2-a8c9b5ba39eb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:06.607472 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-801731be-0e71-47ec-b4b2-a8c9b5ba39eb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:06.608243 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-801731be-0e71-47ec-b4b2-a8c9b5ba39eb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:06.608680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-801731be-0e71-47ec-b4b2-a8c9b5ba39eb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:06.772991 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9ea17804-de79-4f65-8dbb-9a510dd03968 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:06.781490 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9ea17804-de79-4f65-8dbb-9a510dd03968 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1680 microversion: 2.1 time: 0.220813 May 17 18:17:06.782357 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 328/676] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:06 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:06.803928 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-801731be-0e71-47ec-b4b2-a8c9b5ba39eb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:06.812138 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-801731be-0e71-47ec-b4b2-a8c9b5ba39eb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.216846 May 17 18:17:06.812799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 349/677] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:06 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:07.798183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-214e4fa6-7fa0-476d-8e3c-df494b738690 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:07.798831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-214e4fa6-7fa0-476d-8e3c-df494b738690 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:07.805297 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-214e4fa6-7fa0-476d-8e3c-df494b738690 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:07.805749 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-214e4fa6-7fa0-476d-8e3c-df494b738690 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:07.806538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-214e4fa6-7fa0-476d-8e3c-df494b738690 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:07.807006 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-214e4fa6-7fa0-476d-8e3c-df494b738690 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:07.830509 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-24509e56-b699-424b-bef5-7014702d0ee3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:07.831144 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-24509e56-b699-424b-bef5-7014702d0ee3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:07.838119 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-24509e56-b699-424b-bef5-7014702d0ee3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:07.838587 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-24509e56-b699-424b-bef5-7014702d0ee3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:07.839369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-24509e56-b699-424b-bef5-7014702d0ee3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:07.839809 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-24509e56-b699-424b-bef5-7014702d0ee3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:08.007494 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-214e4fa6-7fa0-476d-8e3c-df494b738690 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:08.016662 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-214e4fa6-7fa0-476d-8e3c-df494b738690 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1680 microversion: 2.1 time: 0.222244 May 17 18:17:08.026765 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 329/678] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:07 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:08.032351 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-24509e56-b699-424b-bef5-7014702d0ee3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:08.040222 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-24509e56-b699-424b-bef5-7014702d0ee3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.213551 May 17 18:17:08.040788 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 350/679] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:07 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:09.032922 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e9646d03-f387-48f3-a922-3d67d5a9e973 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:09.033533 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e9646d03-f387-48f3-a922-3d67d5a9e973 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:09.039700 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e9646d03-f387-48f3-a922-3d67d5a9e973 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:09.040156 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e9646d03-f387-48f3-a922-3d67d5a9e973 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:09.040936 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e9646d03-f387-48f3-a922-3d67d5a9e973 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:09.041379 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e9646d03-f387-48f3-a922-3d67d5a9e973 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:09.057556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-35b7323d-d73f-479e-9c9c-562f59cc13aa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:09.058384 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-35b7323d-d73f-479e-9c9c-562f59cc13aa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:09.064558 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35b7323d-d73f-479e-9c9c-562f59cc13aa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:09.065087 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35b7323d-d73f-479e-9c9c-562f59cc13aa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:09.065927 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35b7323d-d73f-479e-9c9c-562f59cc13aa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:09.066462 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35b7323d-d73f-479e-9c9c-562f59cc13aa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:09.302317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e9646d03-f387-48f3-a922-3d67d5a9e973 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:09.311044 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e9646d03-f387-48f3-a922-3d67d5a9e973 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1680 microversion: 2.1 time: 0.281884 May 17 18:17:09.311602 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 330/680] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:09 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:09.352444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-35b7323d-d73f-479e-9c9c-562f59cc13aa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:09.360727 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-35b7323d-d73f-479e-9c9c-562f59cc13aa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.307354 May 17 18:17:09.361336 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 351/681] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:09 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:10.328265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ef2f0f5d-3a8a-4ee2-b7e9-fd6e27d3d7ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:10.328798 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ef2f0f5d-3a8a-4ee2-b7e9-fd6e27d3d7ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:10.335832 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ef2f0f5d-3a8a-4ee2-b7e9-fd6e27d3d7ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:10.336281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ef2f0f5d-3a8a-4ee2-b7e9-fd6e27d3d7ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:10.337053 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ef2f0f5d-3a8a-4ee2-b7e9-fd6e27d3d7ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:10.337485 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ef2f0f5d-3a8a-4ee2-b7e9-fd6e27d3d7ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:10.378266 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-eeb0bd92-d9c1-4c76-882a-6a4bd526a986 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:10.378918 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-eeb0bd92-d9c1-4c76-882a-6a4bd526a986 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:10.385237 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eeb0bd92-d9c1-4c76-882a-6a4bd526a986 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:10.385698 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eeb0bd92-d9c1-4c76-882a-6a4bd526a986 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:10.386478 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eeb0bd92-d9c1-4c76-882a-6a4bd526a986 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:10.387018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-eeb0bd92-d9c1-4c76-882a-6a4bd526a986 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:10.508627 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ef2f0f5d-3a8a-4ee2-b7e9-fd6e27d3d7ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:10.516152 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ef2f0f5d-3a8a-4ee2-b7e9-fd6e27d3d7ee tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1680 microversion: 2.1 time: 0.192174 May 17 18:17:10.516823 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 331/682] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:10 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:10.543130 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-eeb0bd92-d9c1-4c76-882a-6a4bd526a986 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:10.551024 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-eeb0bd92-d9c1-4c76-882a-6a4bd526a986 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.176654 May 17 18:17:10.551589 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 352/683] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:10 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:11.533199 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f5b00ed4-1931-4494-87a8-e783d2fe0457 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:11.533831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f5b00ed4-1931-4494-87a8-e783d2fe0457 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:11.541224 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f5b00ed4-1931-4494-87a8-e783d2fe0457 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:11.541683 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f5b00ed4-1931-4494-87a8-e783d2fe0457 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:11.542456 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f5b00ed4-1931-4494-87a8-e783d2fe0457 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:11.542933 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f5b00ed4-1931-4494-87a8-e783d2fe0457 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:11.568909 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-effac68d-ca96-4c50-953e-ad9a84d6ea93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:11.569527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-effac68d-ca96-4c50-953e-ad9a84d6ea93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:11.575951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-effac68d-ca96-4c50-953e-ad9a84d6ea93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:11.576404 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-effac68d-ca96-4c50-953e-ad9a84d6ea93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:11.577205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-effac68d-ca96-4c50-953e-ad9a84d6ea93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:11.577641 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-effac68d-ca96-4c50-953e-ad9a84d6ea93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:11.729591 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f5b00ed4-1931-4494-87a8-e783d2fe0457 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:11.737068 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f5b00ed4-1931-4494-87a8-e783d2fe0457 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1680 microversion: 2.1 time: 0.207728 May 17 18:17:11.737643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 332/684] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:11 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:11.756669 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-effac68d-ca96-4c50-953e-ad9a84d6ea93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:11.764525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-effac68d-ca96-4c50-953e-ad9a84d6ea93 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.199840 May 17 18:17:11.765034 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 353/685] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:11 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:12.287330 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f0a38ac1-ad94-4630-b235-332314a95a2e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:12.288428 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f0a38ac1-ad94-4630-b235-332314a95a2e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:12.294301 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0a38ac1-ad94-4630-b235-332314a95a2e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:12.294807 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0a38ac1-ad94-4630-b235-332314a95a2e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:12.295574 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0a38ac1-ad94-4630-b235-332314a95a2e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:12.296018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0a38ac1-ad94-4630-b235-332314a95a2e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:12.365720 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f0a38ac1-ad94-4630-b235-332314a95a2e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "POST /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/action" status: 202 len: 0 microversion: 2.1 time: 0.081916 May 17 18:17:12.366428 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 333/686] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:17:12 2022] POST /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:17:12.374380 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5f0626f1-ea68-4993-a3ef-6ac10dc1a191 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:12.375119 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5f0626f1-ea68-4993-a3ef-6ac10dc1a191 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:12.381633 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f0626f1-ea68-4993-a3ef-6ac10dc1a191 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:12.382393 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f0626f1-ea68-4993-a3ef-6ac10dc1a191 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:12.383290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f0626f1-ea68-4993-a3ef-6ac10dc1a191 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:12.383799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f0626f1-ea68-4993-a3ef-6ac10dc1a191 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:12.533819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5f0626f1-ea68-4993-a3ef-6ac10dc1a191 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:12.541737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5f0626f1-ea68-4993-a3ef-6ac10dc1a191 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1751 microversion: 2.1 time: 0.171213 May 17 18:17:12.542316 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 354/687] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:12 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:12.757813 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-391a98f7-0834-40a4-b0c5-43efa818c3e7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:12.758515 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-391a98f7-0834-40a4-b0c5-43efa818c3e7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:12.765061 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-391a98f7-0834-40a4-b0c5-43efa818c3e7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:12.765513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-391a98f7-0834-40a4-b0c5-43efa818c3e7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:12.766292 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-391a98f7-0834-40a4-b0c5-43efa818c3e7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:12.766758 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-391a98f7-0834-40a4-b0c5-43efa818c3e7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:12.781364 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5b617225-2a1b-4b0b-9272-a42f437b84b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:12.782058 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5b617225-2a1b-4b0b-9272-a42f437b84b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:12.789003 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b617225-2a1b-4b0b-9272-a42f437b84b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:12.789462 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b617225-2a1b-4b0b-9272-a42f437b84b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:12.790468 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b617225-2a1b-4b0b-9272-a42f437b84b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:12.790939 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b617225-2a1b-4b0b-9272-a42f437b84b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:12.966310 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-391a98f7-0834-40a4-b0c5-43efa818c3e7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:12.977205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-391a98f7-0834-40a4-b0c5-43efa818c3e7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1657 microversion: 2.1 time: 0.224865 May 17 18:17:12.978109 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 334/688] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:12 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1657 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:12.979676 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5b617225-2a1b-4b0b-9272-a42f437b84b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:12.988157 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5b617225-2a1b-4b0b-9272-a42f437b84b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.210475 May 17 18:17:12.993317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-49bc8bb0-c9f9-426e-9028-d05bdd5a19aa tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:12.998265 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 355/689] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:12 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:12.999186 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-49bc8bb0-c9f9-426e-9028-d05bdd5a19aa tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:12.999638 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-49bc8bb0-c9f9-426e-9028-d05bdd5a19aa tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:13.021380 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-49bc8bb0-c9f9-426e-9028-d05bdd5a19aa tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Going to try to start instance {{(pid=117020) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 18:17:13.065668 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-49bc8bb0-c9f9-426e-9028-d05bdd5a19aa tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/action" status: 202 len: 0 microversion: 2.1 time: 0.075963 May 17 18:17:13.066471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 335/690] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:17:12 2022] POST /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:17:13.075574 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5d6dd5c7-79a8-469b-8390-d45947b10f05 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:13.076350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5d6dd5c7-79a8-469b-8390-d45947b10f05 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:13.082951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5d6dd5c7-79a8-469b-8390-d45947b10f05 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:13.083712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5d6dd5c7-79a8-469b-8390-d45947b10f05 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:13.084501 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5d6dd5c7-79a8-469b-8390-d45947b10f05 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:13.085045 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5d6dd5c7-79a8-469b-8390-d45947b10f05 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:13.254839 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5d6dd5c7-79a8-469b-8390-d45947b10f05 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:13.262206 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5d6dd5c7-79a8-469b-8390-d45947b10f05 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1666 microversion: 2.1 time: 0.190591 May 17 18:17:13.263202 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 356/691] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:13 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1666 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:13.559746 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8b9d87da-20d2-4abc-91e8-b1b5f065cf37 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:13.560448 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8b9d87da-20d2-4abc-91e8-b1b5f065cf37 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:13.566447 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8b9d87da-20d2-4abc-91e8-b1b5f065cf37 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:13.566929 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8b9d87da-20d2-4abc-91e8-b1b5f065cf37 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:13.567970 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8b9d87da-20d2-4abc-91e8-b1b5f065cf37 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:13.568610 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8b9d87da-20d2-4abc-91e8-b1b5f065cf37 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:13.801263 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8b9d87da-20d2-4abc-91e8-b1b5f065cf37 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:13.809084 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8b9d87da-20d2-4abc-91e8-b1b5f065cf37 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1756 microversion: 2.1 time: 0.253600 May 17 18:17:13.809660 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 336/692] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:13 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:14.005317 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7ca1120b-129e-4a77-8d79-89daeb3f7846 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:14.006501 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7ca1120b-129e-4a77-8d79-89daeb3f7846 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:14.012895 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7ca1120b-129e-4a77-8d79-89daeb3f7846 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:14.013345 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7ca1120b-129e-4a77-8d79-89daeb3f7846 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:14.014110 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7ca1120b-129e-4a77-8d79-89daeb3f7846 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:14.014544 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7ca1120b-129e-4a77-8d79-89daeb3f7846 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:14.146516 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7ca1120b-129e-4a77-8d79-89daeb3f7846 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:14.154191 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7ca1120b-129e-4a77-8d79-89daeb3f7846 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.152837 May 17 18:17:14.154789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 357/693] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:14 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:14.279982 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f1b46486-16f3-4a61-a280-d7b266b6bf0d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:14.280590 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f1b46486-16f3-4a61-a280-d7b266b6bf0d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:14.286539 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f1b46486-16f3-4a61-a280-d7b266b6bf0d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:14.287019 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f1b46486-16f3-4a61-a280-d7b266b6bf0d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:14.287982 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f1b46486-16f3-4a61-a280-d7b266b6bf0d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:14.288421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f1b46486-16f3-4a61-a280-d7b266b6bf0d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:14.413700 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f1b46486-16f3-4a61-a280-d7b266b6bf0d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:14.421113 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f1b46486-16f3-4a61-a280-d7b266b6bf0d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1666 microversion: 2.1 time: 0.144907 May 17 18:17:14.421683 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 337/694] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:14 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1666 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:14.827578 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-bf0282e9-1fde-49b7-910d-efbc53ec5f1f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:14.828212 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-bf0282e9-1fde-49b7-910d-efbc53ec5f1f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:14.834472 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bf0282e9-1fde-49b7-910d-efbc53ec5f1f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:14.835040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bf0282e9-1fde-49b7-910d-efbc53ec5f1f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:14.835818 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bf0282e9-1fde-49b7-910d-efbc53ec5f1f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:14.836232 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bf0282e9-1fde-49b7-910d-efbc53ec5f1f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:14.975383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-bf0282e9-1fde-49b7-910d-efbc53ec5f1f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:14.983824 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-bf0282e9-1fde-49b7-910d-efbc53ec5f1f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1756 microversion: 2.1 time: 0.160223 May 17 18:17:14.984400 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 358/695] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:14 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:15.171033 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e0228303-0a5a-4f35-825a-87e50810232e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:15.171587 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e0228303-0a5a-4f35-825a-87e50810232e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:15.178917 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e0228303-0a5a-4f35-825a-87e50810232e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:15.179374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e0228303-0a5a-4f35-825a-87e50810232e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:15.180148 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e0228303-0a5a-4f35-825a-87e50810232e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:15.180588 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e0228303-0a5a-4f35-825a-87e50810232e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:15.306852 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e0228303-0a5a-4f35-825a-87e50810232e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:15.314479 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e0228303-0a5a-4f35-825a-87e50810232e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.147379 May 17 18:17:15.315150 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 338/696] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:15 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:15.438854 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3aae1bed-0f54-44b3-a65a-aedccc4e778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:15.439460 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3aae1bed-0f54-44b3-a65a-aedccc4e778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:15.446692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3aae1bed-0f54-44b3-a65a-aedccc4e778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:15.447142 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3aae1bed-0f54-44b3-a65a-aedccc4e778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:15.447905 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3aae1bed-0f54-44b3-a65a-aedccc4e778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:15.448335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3aae1bed-0f54-44b3-a65a-aedccc4e778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:15.574164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3aae1bed-0f54-44b3-a65a-aedccc4e778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:15.581389 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3aae1bed-0f54-44b3-a65a-aedccc4e778a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1670 microversion: 2.1 time: 0.146350 May 17 18:17:15.581948 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 359/697] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:15 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1670 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:16.000698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-080b0656-e8c3-4ec6-9284-954c7cfaf667 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:16.001338 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-080b0656-e8c3-4ec6-9284-954c7cfaf667 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:16.007572 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-080b0656-e8c3-4ec6-9284-954c7cfaf667 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:16.008019 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-080b0656-e8c3-4ec6-9284-954c7cfaf667 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:16.008777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-080b0656-e8c3-4ec6-9284-954c7cfaf667 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:16.009208 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-080b0656-e8c3-4ec6-9284-954c7cfaf667 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:16.150722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-080b0656-e8c3-4ec6-9284-954c7cfaf667 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:16.158446 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-080b0656-e8c3-4ec6-9284-954c7cfaf667 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1756 microversion: 2.1 time: 0.161574 May 17 18:17:16.159038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 339/698] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:15 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:16.331972 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a57f6c19-389f-4fcc-9f00-a8278f4dd5c6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:16.332585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a57f6c19-389f-4fcc-9f00-a8278f4dd5c6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:16.339018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57f6c19-389f-4fcc-9f00-a8278f4dd5c6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:16.339469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57f6c19-389f-4fcc-9f00-a8278f4dd5c6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:16.340236 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57f6c19-389f-4fcc-9f00-a8278f4dd5c6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:16.340675 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a57f6c19-389f-4fcc-9f00-a8278f4dd5c6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:16.470761 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a57f6c19-389f-4fcc-9f00-a8278f4dd5c6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:16.479105 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a57f6c19-389f-4fcc-9f00-a8278f4dd5c6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.151004 May 17 18:17:16.479676 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 360/699] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:16 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:17.175345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-24487864-73fb-402d-95fd-ea7cc3b78699 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:17.175933 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-24487864-73fb-402d-95fd-ea7cc3b78699 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:17.182696 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-24487864-73fb-402d-95fd-ea7cc3b78699 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:17.183145 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-24487864-73fb-402d-95fd-ea7cc3b78699 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:17.183901 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-24487864-73fb-402d-95fd-ea7cc3b78699 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:17.184334 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-24487864-73fb-402d-95fd-ea7cc3b78699 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:17.326146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-24487864-73fb-402d-95fd-ea7cc3b78699 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:17.333813 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-24487864-73fb-402d-95fd-ea7cc3b78699 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1756 microversion: 2.1 time: 0.162341 May 17 18:17:17.334419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 340/700] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:17 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:17.496068 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7c16b3ea-77f7-4e36-bfea-a69fce1c5241 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:17.496706 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7c16b3ea-77f7-4e36-bfea-a69fce1c5241 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:17.503013 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7c16b3ea-77f7-4e36-bfea-a69fce1c5241 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:17.503470 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7c16b3ea-77f7-4e36-bfea-a69fce1c5241 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:17.504235 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7c16b3ea-77f7-4e36-bfea-a69fce1c5241 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:17.504682 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7c16b3ea-77f7-4e36-bfea-a69fce1c5241 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:17.632293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7c16b3ea-77f7-4e36-bfea-a69fce1c5241 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:17.639984 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7c16b3ea-77f7-4e36-bfea-a69fce1c5241 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.147736 May 17 18:17:17.640551 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 361/701] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:17 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:18.350983 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-39ff2731-f5f8-478e-bed2-7d7de1d9449e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:18.351590 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-39ff2731-f5f8-478e-bed2-7d7de1d9449e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:18.357776 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39ff2731-f5f8-478e-bed2-7d7de1d9449e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:18.358221 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39ff2731-f5f8-478e-bed2-7d7de1d9449e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:18.359004 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39ff2731-f5f8-478e-bed2-7d7de1d9449e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:18.359437 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39ff2731-f5f8-478e-bed2-7d7de1d9449e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:18.498972 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-39ff2731-f5f8-478e-bed2-7d7de1d9449e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:18.507418 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-39ff2731-f5f8-478e-bed2-7d7de1d9449e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1756 microversion: 2.1 time: 0.160418 May 17 18:17:18.507980 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 341/702] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:18 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:18.656427 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d443fd1e-be0d-4786-a0d3-1bfd0881f2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:18.656989 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d443fd1e-be0d-4786-a0d3-1bfd0881f2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:18.663545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d443fd1e-be0d-4786-a0d3-1bfd0881f2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:18.664000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d443fd1e-be0d-4786-a0d3-1bfd0881f2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:18.664761 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d443fd1e-be0d-4786-a0d3-1bfd0881f2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:18.665199 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d443fd1e-be0d-4786-a0d3-1bfd0881f2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:18.790986 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d443fd1e-be0d-4786-a0d3-1bfd0881f2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:18.798755 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d443fd1e-be0d-4786-a0d3-1bfd0881f2b9 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1736 microversion: 2.1 time: 0.146262 May 17 18:17:18.799322 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 362/703] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:18 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:19.524348 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-dcda21e6-539f-4061-a354-e2624ca9234b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:19.525018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-dcda21e6-539f-4061-a354-e2624ca9234b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:19.531452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dcda21e6-539f-4061-a354-e2624ca9234b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:19.531913 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dcda21e6-539f-4061-a354-e2624ca9234b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:19.532658 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dcda21e6-539f-4061-a354-e2624ca9234b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:19.533095 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dcda21e6-539f-4061-a354-e2624ca9234b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:19.679000 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-dcda21e6-539f-4061-a354-e2624ca9234b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:19.690237 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-dcda21e6-539f-4061-a354-e2624ca9234b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1756 microversion: 2.1 time: 0.170427 May 17 18:17:19.690845 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 342/704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:19 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:19.816056 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-567675d8-4b0d-4c4d-ad21-7c5ab163481b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:19.816598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-567675d8-4b0d-4c4d-ad21-7c5ab163481b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:19.823676 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-567675d8-4b0d-4c4d-ad21-7c5ab163481b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:19.824137 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-567675d8-4b0d-4c4d-ad21-7c5ab163481b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:19.824914 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-567675d8-4b0d-4c4d-ad21-7c5ab163481b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:19.825357 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-567675d8-4b0d-4c4d-ad21-7c5ab163481b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:19.936191 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6ee8b7a7-09fc-4999-a63f-5ca92d22b17c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:19.936678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6ee8b7a7-09fc-4999-a63f-5ca92d22b17c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:19.942853 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6ee8b7a7-09fc-4999-a63f-5ca92d22b17c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:19.944107 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6ee8b7a7-09fc-4999-a63f-5ca92d22b17c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:19.944880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6ee8b7a7-09fc-4999-a63f-5ca92d22b17c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:19.945313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6ee8b7a7-09fc-4999-a63f-5ca92d22b17c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:19.952844 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-567675d8-4b0d-4c4d-ad21-7c5ab163481b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:19.961562 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-567675d8-4b0d-4c4d-ad21-7c5ab163481b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1716 microversion: 2.1 time: 0.149437 May 17 18:17:19.962139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 363/705] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:19 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:19.975628 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6ee8b7a7-09fc-4999-a63f-5ca92d22b17c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-volume_attachments/af7cb74e-9a93-4adb-b6e0-962b25eddef3" status: 200 len: 194 microversion: 2.20 time: 0.043362 May 17 18:17:19.976236 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 343/706] 10.222.0.25 () {60 vars in 1453 bytes} [Tue May 17 18:17:19 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-volume_attachments/af7cb74e-9a93-4adb-b6e0-962b25eddef3 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:17:20.036437 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d3376d0c-925a-48e7-ab98-39dc8647b6c7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:20.036985 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d3376d0c-925a-48e7-ab98-39dc8647b6c7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:20.042805 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d3376d0c-925a-48e7-ab98-39dc8647b6c7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.043257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d3376d0c-925a-48e7-ab98-39dc8647b6c7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.044025 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d3376d0c-925a-48e7-ab98-39dc8647b6c7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.044458 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d3376d0c-925a-48e7-ab98-39dc8647b6c7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.063126 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6201042f-68f0-4027-95cf-99858f9cb14f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:20.063651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6201042f-68f0-4027-95cf-99858f9cb14f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:20.069885 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6201042f-68f0-4027-95cf-99858f9cb14f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.070282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6201042f-68f0-4027-95cf-99858f9cb14f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.071086 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6201042f-68f0-4027-95cf-99858f9cb14f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.071525 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6201042f-68f0-4027-95cf-99858f9cb14f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.124439 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-d3376d0c-925a-48e7-ab98-39dc8647b6c7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lazy-loading 'services' on Instance uuid 769abf30-807c-41f0-bd94-0809137c0155 {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:17:20.152559 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-6201042f-68f0-4027-95cf-99858f9cb14f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] HTTP exception thrown: Cannot 'detach_volume' instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb while it is in vm_state rescued May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6201042f-68f0-4027-95cf-99858f9cb14f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Request method failure captured: May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: DELETE /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments/32bacdf1-a92f-4167-a3ae-c052d1de4843 HTTP/1.1 May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WzWKI_qp77YHLeymkbA2nMR_qjOtmmqk6FaK9Yh75xjb8QQi3BjnX6MQP8riZ5sjsky4n7JVdRB8b1lc7H08V0xUoslnGDT-ip1glIuAAu0KM-xhJdoQgc3lKpgHfXh5chSWnW0mA98TTJaSlVnRvKoUQkzDfbsJt1EL74HYlh9BI May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: e32e7b68f0464827afc5ed835cee1d15 May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:17:20.154346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e32e7b68f0464827afc5ed835cee1d15", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: e32e7b68f0464827afc5ed835cee1d15 May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-ServerRescueNegativeTestJSON-1083069676-project May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 62a9f27a865b468989f672a05dbab350 May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1083069676-project May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:17:20.155957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Cannot 'detach_volume' instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb while it is in vm_state rescued May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'server_id': '1966aa90-f5e3-4591-8105-69f6cc0fbdfb', 'id': '32bacdf1-a92f-4167-a3ae-c052d1de4843'} May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb in vm_state rescued. Cannot detach_volume while the instance is in this state. May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:17:20.160313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb while it is in vm_state rescued May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb while it is in vm_state rescued May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:17:20.161647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6201042f-68f0-4027-95cf-99858f9cb14f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Returning 409 to user: Cannot 'detach_volume' instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb while it is in vm_state rescued {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:17:20.162815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6201042f-68f0-4027-95cf-99858f9cb14f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments/32bacdf1-a92f-4167-a3ae-c052d1de4843" status: 409 len: 152 microversion: 2.1 time: 0.096769 May 17 18:17:20.162815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 344/707] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:17:20 2022] DELETE /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments/32bacdf1-a92f-4167-a3ae-c052d1de4843 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 17 18:17:20.164481 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f4d11755-d9cf-41dc-adb7-e3367ece2c54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:20.165007 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f4d11755-d9cf-41dc-adb7-e3367ece2c54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:20.171523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f4d11755-d9cf-41dc-adb7-e3367ece2c54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.171977 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f4d11755-d9cf-41dc-adb7-e3367ece2c54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.172752 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f4d11755-d9cf-41dc-adb7-e3367ece2c54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.173195 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f4d11755-d9cf-41dc-adb7-e3367ece2c54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.197354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d3376d0c-925a-48e7-ab98-39dc8647b6c7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-volume_attachments/af7cb74e-9a93-4adb-b6e0-962b25eddef3" status: 202 len: 0 microversion: 2.20 time: 0.165157 May 17 18:17:20.198400 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 364/708] 10.222.0.25 () {60 vars in 1456 bytes} [Tue May 17 18:17:20 2022] DELETE /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-volume_attachments/af7cb74e-9a93-4adb-b6e0-962b25eddef3 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:17:20.207680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-694efcee-8312-4455-8ee0-4c70e2fe3dc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:20.208768 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-694efcee-8312-4455-8ee0-4c70e2fe3dc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:20.215268 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-694efcee-8312-4455-8ee0-4c70e2fe3dc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.215714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-694efcee-8312-4455-8ee0-4c70e2fe3dc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.216482 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-694efcee-8312-4455-8ee0-4c70e2fe3dc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.216954 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-694efcee-8312-4455-8ee0-4c70e2fe3dc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.243128 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f4d11755-d9cf-41dc-adb7-e3367ece2c54 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "POST /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/action" status: 202 len: 0 microversion: 2.1 time: 0.081496 May 17 18:17:20.247052 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 345/709] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:17:20 2022] POST /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:17:20.253318 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-694efcee-8312-4455-8ee0-4c70e2fe3dc5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050687 May 17 18:17:20.255120 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 365/710] 10.222.0.25 () {60 vars in 1342 bytes} [Tue May 17 18:17:20 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:17:20.256089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-12b889cd-ba9a-40ad-96ba-000e87c6e0b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:20.256796 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-12b889cd-ba9a-40ad-96ba-000e87c6e0b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:20.263928 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-12b889cd-ba9a-40ad-96ba-000e87c6e0b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.264409 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-12b889cd-ba9a-40ad-96ba-000e87c6e0b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.265143 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-12b889cd-ba9a-40ad-96ba-000e87c6e0b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.265586 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-12b889cd-ba9a-40ad-96ba-000e87c6e0b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.432370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-12b889cd-ba9a-40ad-96ba-000e87c6e0b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:20.440281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-12b889cd-ba9a-40ad-96ba-000e87c6e0b6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1724 microversion: 2.1 time: 0.188478 May 17 18:17:20.440846 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 346/711] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:20 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:20.707970 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4c9a38cf-4274-4aaa-9626-c9b970460aa0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:20.708737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4c9a38cf-4274-4aaa-9626-c9b970460aa0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:20.718541 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4c9a38cf-4274-4aaa-9626-c9b970460aa0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.719045 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4c9a38cf-4274-4aaa-9626-c9b970460aa0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.720021 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4c9a38cf-4274-4aaa-9626-c9b970460aa0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:20.720451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4c9a38cf-4274-4aaa-9626-c9b970460aa0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:20.943959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4c9a38cf-4274-4aaa-9626-c9b970460aa0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:20.951812 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4c9a38cf-4274-4aaa-9626-c9b970460aa0 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1756 microversion: 2.1 time: 0.247916 May 17 18:17:20.952384 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 366/712] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:20 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1756 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:21.266192 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-75d17ab0-84e1-453a-9e93-a92158fa2da5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:21.267138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-75d17ab0-84e1-453a-9e93-a92158fa2da5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:21.274382 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75d17ab0-84e1-453a-9e93-a92158fa2da5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:21.274877 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75d17ab0-84e1-453a-9e93-a92158fa2da5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:21.275653 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75d17ab0-84e1-453a-9e93-a92158fa2da5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:21.276105 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75d17ab0-84e1-453a-9e93-a92158fa2da5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:21.304336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-75d17ab0-84e1-453a-9e93-a92158fa2da5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042173 May 17 18:17:21.304881 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 347/713] 10.222.0.25 () {60 vars in 1342 bytes} [Tue May 17 18:17:21 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:21.360564 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d497c8f2-ab1f-43fc-8357-9c0a4d26f093 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:21.361063 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d497c8f2-ab1f-43fc-8357-9c0a4d26f093 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:21.366874 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d497c8f2-ab1f-43fc-8357-9c0a4d26f093 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:21.367328 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d497c8f2-ab1f-43fc-8357-9c0a4d26f093 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:21.368091 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d497c8f2-ab1f-43fc-8357-9c0a4d26f093 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:21.368527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d497c8f2-ab1f-43fc-8357-9c0a4d26f093 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:21.392682 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d497c8f2-ab1f-43fc-8357-9c0a4d26f093 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:17:21.458880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f1fed68c-d601-4653-b31d-920e2acfbfb3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:21.460098 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f1fed68c-d601-4653-b31d-920e2acfbfb3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:21.465867 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d497c8f2-ab1f-43fc-8357-9c0a4d26f093 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 204 len: 0 microversion: 2.20 time: 0.108687 May 17 18:17:21.466466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 367/714] 10.222.0.25 () {60 vars in 1279 bytes} [Tue May 17 18:17:21 2022] DELETE /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 18:17:21.466719 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f1fed68c-d601-4653-b31d-920e2acfbfb3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:21.467174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f1fed68c-d601-4653-b31d-920e2acfbfb3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:21.467941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f1fed68c-d601-4653-b31d-920e2acfbfb3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:21.468402 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f1fed68c-d601-4653-b31d-920e2acfbfb3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:21.475179 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9224ab79-e7df-47a3-abf0-52b1f3e2d448 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:21.475878 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9224ab79-e7df-47a3-abf0-52b1f3e2d448 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:21.481840 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9224ab79-e7df-47a3-abf0-52b1f3e2d448 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:21.482298 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9224ab79-e7df-47a3-abf0-52b1f3e2d448 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:21.483131 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9224ab79-e7df-47a3-abf0-52b1f3e2d448 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:21.483573 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9224ab79-e7df-47a3-abf0-52b1f3e2d448 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:21.660947 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f1fed68c-d601-4653-b31d-920e2acfbfb3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:21.664816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9224ab79-e7df-47a3-abf0-52b1f3e2d448 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:21.668823 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f1fed68c-d601-4653-b31d-920e2acfbfb3 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1724 microversion: 2.1 time: 0.214022 May 17 18:17:21.669396 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 348/715] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:21 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:21.674700 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9224ab79-e7df-47a3-abf0-52b1f3e2d448 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:21.674700 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9224ab79-e7df-47a3-abf0-52b1f3e2d448 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:21.675229 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9224ab79-e7df-47a3-abf0-52b1f3e2d448 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.204199 May 17 18:17:21.675782 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 368/716] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:21 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:17:21.969410 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a6b8e18a-e2cc-4087-9a8f-7747dfceb8e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:21.970015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a6b8e18a-e2cc-4087-9a8f-7747dfceb8e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:21.976672 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6b8e18a-e2cc-4087-9a8f-7747dfceb8e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:21.977124 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6b8e18a-e2cc-4087-9a8f-7747dfceb8e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:21.977889 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6b8e18a-e2cc-4087-9a8f-7747dfceb8e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:21.978327 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6b8e18a-e2cc-4087-9a8f-7747dfceb8e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:22.120417 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a6b8e18a-e2cc-4087-9a8f-7747dfceb8e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:22.128192 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a6b8e18a-e2cc-4087-9a8f-7747dfceb8e9 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1756 microversion: 2.1 time: 0.162662 May 17 18:17:22.128747 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 349/717] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:21 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:22.688642 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fdf6c693-18bc-4a63-8904-534bf444d161 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:22.689253 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-fdf6c693-18bc-4a63-8904-534bf444d161 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:22.696870 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fdf6c693-18bc-4a63-8904-534bf444d161 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:22.697326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fdf6c693-18bc-4a63-8904-534bf444d161 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:22.698123 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fdf6c693-18bc-4a63-8904-534bf444d161 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:22.698468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f73b7a88-07af-456d-ba5e-8de334366968 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:22.698982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fdf6c693-18bc-4a63-8904-534bf444d161 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:22.699327 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f73b7a88-07af-456d-ba5e-8de334366968 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:22.706427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f73b7a88-07af-456d-ba5e-8de334366968 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:22.707000 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f73b7a88-07af-456d-ba5e-8de334366968 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:22.707865 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f73b7a88-07af-456d-ba5e-8de334366968 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:22.708369 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f73b7a88-07af-456d-ba5e-8de334366968 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:22.893753 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-fdf6c693-18bc-4a63-8904-534bf444d161 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:22.898671 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f73b7a88-07af-456d-ba5e-8de334366968 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:22.902394 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-fdf6c693-18bc-4a63-8904-534bf444d161 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1724 microversion: 2.1 time: 0.217817 May 17 18:17:22.903006 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 369/718] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:22 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:22.906446 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f73b7a88-07af-456d-ba5e-8de334366968 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:22.907990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f73b7a88-07af-456d-ba5e-8de334366968 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:22.909146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f73b7a88-07af-456d-ba5e-8de334366968 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.216577 May 17 18:17:22.909697 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 350/719] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:22 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:23.145251 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-10af7b9f-e121-4f05-9212-d763845a94d7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:23.145779 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-10af7b9f-e121-4f05-9212-d763845a94d7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:23.151814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-10af7b9f-e121-4f05-9212-d763845a94d7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:23.152262 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-10af7b9f-e121-4f05-9212-d763845a94d7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:23.153016 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-10af7b9f-e121-4f05-9212-d763845a94d7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:23.153448 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-10af7b9f-e121-4f05-9212-d763845a94d7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:23.296144 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-10af7b9f-e121-4f05-9212-d763845a94d7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:23.304312 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-10af7b9f-e121-4f05-9212-d763845a94d7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1756 microversion: 2.1 time: 0.163072 May 17 18:17:23.304871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 370/720] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:23 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:23.919520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fc2d1478-9e68-4be8-8d71-ef223581aac1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:23.920059 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fc2d1478-9e68-4be8-8d71-ef223581aac1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:23.927570 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc2d1478-9e68-4be8-8d71-ef223581aac1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:23.928020 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc2d1478-9e68-4be8-8d71-ef223581aac1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:23.928718 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-93283aef-1ffb-4522-8bf5-f999dda51484 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:23.929112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc2d1478-9e68-4be8-8d71-ef223581aac1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:23.929248 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc2d1478-9e68-4be8-8d71-ef223581aac1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:23.929399 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-93283aef-1ffb-4522-8bf5-f999dda51484 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:23.935575 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93283aef-1ffb-4522-8bf5-f999dda51484 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:23.936027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93283aef-1ffb-4522-8bf5-f999dda51484 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:23.936795 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93283aef-1ffb-4522-8bf5-f999dda51484 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:23.937229 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93283aef-1ffb-4522-8bf5-f999dda51484 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:24.348174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-fc2d1478-9e68-4be8-8d71-ef223581aac1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:24.352472 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-93283aef-1ffb-4522-8bf5-f999dda51484 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:24.356983 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fc2d1478-9e68-4be8-8d71-ef223581aac1 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1724 microversion: 2.1 time: 0.441359 May 17 18:17:24.357566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 351/721] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:23 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1724 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:24.360335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-93283aef-1ffb-4522-8bf5-f999dda51484 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:24.361817 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-93283aef-1ffb-4522-8bf5-f999dda51484 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:24.362976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-93283aef-1ffb-4522-8bf5-f999dda51484 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.438520 May 17 18:17:24.363673 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 371/722] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:23 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:17:24.368068 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-358fb8b2-64ad-44c6-8a17-4f94f6cc5302 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:24.368692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-358fb8b2-64ad-44c6-8a17-4f94f6cc5302 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:24.374446 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-358fb8b2-64ad-44c6-8a17-4f94f6cc5302 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:24.374942 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-358fb8b2-64ad-44c6-8a17-4f94f6cc5302 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:24.375716 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-358fb8b2-64ad-44c6-8a17-4f94f6cc5302 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:24.376162 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-358fb8b2-64ad-44c6-8a17-4f94f6cc5302 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:24.515234 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-358fb8b2-64ad-44c6-8a17-4f94f6cc5302 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:24.523833 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-358fb8b2-64ad-44c6-8a17-4f94f6cc5302 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1756 microversion: 2.1 time: 0.160031 May 17 18:17:24.524408 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 352/723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:24 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:25.374087 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3ab5bb4b-9adc-400f-bee1-2bdd7c26095a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:25.374822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3ab5bb4b-9adc-400f-bee1-2bdd7c26095a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:25.381657 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-11857732-764d-4b27-9536-b9af5b8ab7d0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:25.382090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ab5bb4b-9adc-400f-bee1-2bdd7c26095a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:25.382225 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ab5bb4b-9adc-400f-bee1-2bdd7c26095a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:25.382395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-11857732-764d-4b27-9536-b9af5b8ab7d0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:25.382974 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ab5bb4b-9adc-400f-bee1-2bdd7c26095a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:25.383407 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ab5bb4b-9adc-400f-bee1-2bdd7c26095a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:25.388614 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11857732-764d-4b27-9536-b9af5b8ab7d0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:25.389065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11857732-764d-4b27-9536-b9af5b8ab7d0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:25.389831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11857732-764d-4b27-9536-b9af5b8ab7d0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:25.390268 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-11857732-764d-4b27-9536-b9af5b8ab7d0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:25.570040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3ab5bb4b-9adc-400f-bee1-2bdd7c26095a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:25.572965 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-11857732-764d-4b27-9536-b9af5b8ab7d0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:25.578031 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3ab5bb4b-9adc-400f-bee1-2bdd7c26095a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1730 microversion: 2.1 time: 0.207865 May 17 18:17:25.578625 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 372/724] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:25 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:25.580731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-11857732-764d-4b27-9536-b9af5b8ab7d0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:25.582244 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-11857732-764d-4b27-9536-b9af5b8ab7d0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:25.582991 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5dd89304-6d05-491d-85b9-bb1c2728b45e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:25.583433 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-11857732-764d-4b27-9536-b9af5b8ab7d0 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1721 microversion: 2.20 time: 0.206315 May 17 18:17:25.583786 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5dd89304-6d05-491d-85b9-bb1c2728b45e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:25.584219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 353/725] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:25 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:17:25.590013 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dd89304-6d05-491d-85b9-bb1c2728b45e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:25.590473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dd89304-6d05-491d-85b9-bb1c2728b45e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:25.591273 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dd89304-6d05-491d-85b9-bb1c2728b45e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:25.591713 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dd89304-6d05-491d-85b9-bb1c2728b45e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:25.594802 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-60622d4b-aeb7-445a-a047-2bdc676b2436 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:25.595296 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-60622d4b-aeb7-445a-a047-2bdc676b2436 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:25.601053 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-60622d4b-aeb7-445a-a047-2bdc676b2436 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:25.601503 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-60622d4b-aeb7-445a-a047-2bdc676b2436 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:25.602312 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-60622d4b-aeb7-445a-a047-2bdc676b2436 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:25.602776 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-60622d4b-aeb7-445a-a047-2bdc676b2436 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:25.714758 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-60622d4b-aeb7-445a-a047-2bdc676b2436 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123885 May 17 18:17:25.715343 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 354/726] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 17 18:17:25 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:17:25.851030 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5dd89304-6d05-491d-85b9-bb1c2728b45e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:25.859120 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5dd89304-6d05-491d-85b9-bb1c2728b45e tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1759 microversion: 2.1 time: 0.279521 May 17 18:17:25.860013 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 373/727] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:25 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1759 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:26.512327 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-c18026e5-1326-4f32-aa31-d8a96f7cc269 req-421224d5-2d03-49b9-9971-895c78f61cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769abf30-807c-41f0-bd94-0809137c0155", "name": "network-vif-deleted", "tag": "cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:26.522950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-c18026e5-1326-4f32-aa31-d8a96f7cc269 req-421224d5-2d03-49b9-9971-895c78f61cee service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:26.523341 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-c18026e5-1326-4f32-aa31-d8a96f7cc269 req-421224d5-2d03-49b9-9971-895c78f61cee service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:26.535383 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-c18026e5-1326-4f32-aa31-d8a96f7cc269 req-421224d5-2d03-49b9-9971-895c78f61cee service nova] Creating event network-vif-deleted:cc30fa87-69cd-4bd8-a8ab-4b205e08bfcb for instance 769abf30-807c-41f0-bd94-0809137c0155 on hv-cinder-84130 May 17 18:17:26.541792 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-c18026e5-1326-4f32-aa31-d8a96f7cc269 req-421224d5-2d03-49b9-9971-895c78f61cee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033725 May 17 18:17:26.542405 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 355/728] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:26.601557 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:26.602160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:26.611861 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:26.612623 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:26.613561 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:26.614422 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:26.646814 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-6ad0a2de-8ecf-4c8f-b6a9-a8519cee2d1a req-80f051af-4233-4142-be2b-53c35138bd47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1966aa90-f5e3-4591-8105-69f6cc0fbdfb", "tag": "c45336db-0e36-4d75-8c9b-f63dc16532f1"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:26.664273 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-6ad0a2de-8ecf-4c8f-b6a9-a8519cee2d1a req-80f051af-4233-4142-be2b-53c35138bd47 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:26.664971 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-6ad0a2de-8ecf-4c8f-b6a9-a8519cee2d1a req-80f051af-4233-4142-be2b-53c35138bd47 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:26.673443 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:26.675314 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:26.676032 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lazy-loading 'fault' on Instance uuid 769abf30-807c-41f0-bd94-0809137c0155 {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:17:26.695785 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-6ad0a2de-8ecf-4c8f-b6a9-a8519cee2d1a req-80f051af-4233-4142-be2b-53c35138bd47 service nova] Creating event network-changed:c45336db-0e36-4d75-8c9b-f63dc16532f1 for instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb on hv-cinder-84130 May 17 18:17:26.707409 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-6ad0a2de-8ecf-4c8f-b6a9-a8519cee2d1a req-80f051af-4233-4142-be2b-53c35138bd47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071450 May 17 18:17:26.710279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 356/729] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:26.733383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:26.749006 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:26.750668 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:26.752778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-99d72826-b651-4952-92b0-02983508590d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 200 len: 1370 microversion: 2.20 time: 0.154464 May 17 18:17:26.752778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 374/730] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:26 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:27.770462 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-79db56ba-fc1e-45e6-82d2-3fdfb90120f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:27.771787 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-79db56ba-fc1e-45e6-82d2-3fdfb90120f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:27.778821 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79db56ba-fc1e-45e6-82d2-3fdfb90120f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:27.779298 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79db56ba-fc1e-45e6-82d2-3fdfb90120f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:27.780065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79db56ba-fc1e-45e6-82d2-3fdfb90120f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:27.780501 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79db56ba-fc1e-45e6-82d2-3fdfb90120f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:27.794109 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-79db56ba-fc1e-45e6-82d2-3fdfb90120f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] HTTP exception thrown: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-79db56ba-fc1e-45e6-82d2-3fdfb90120f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Request method failure captured: May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 HTTP/1.1 May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WghKt9EBDilQWOFZow_WwG159nr2-sRRLv1v99jXI3xJduS9MSEP3m4HaNve0y516mWpgdseao36rUrXKOTj8Emy2RORzFZz6b7MZN1Q_YirN4Fbk7uHaXLXR8O0QshqqyGYn64DV4ZQMbBo1KFgdQbl6-gTxjOIzwtm4tiBV6yQs May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 492389142d804ad392267cb4a728008d May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:17:27.795801 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/492389142d804ad392267cb4a728008d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_492389142d804ad392267cb4a728008d", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 492389142d804ad392267cb4a728008d May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 8ba97b67ecf64476a630fd3667d617fb May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:17:27.797387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '769abf30-807c-41f0-bd94-0809137c0155'} May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:17:27.798513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:17:27.799989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:17:27.801355 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-79db56ba-fc1e-45e6-82d2-3fdfb90120f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Returning 404 to user: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:17:27.801355 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-79db56ba-fc1e-45e6-82d2-3fdfb90120f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 404 len: 111 microversion: 2.20 time: 0.031093 May 17 18:17:27.801355 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 357/731] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:27 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 18:17:27.805950 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9a2f98a8-d7bd-49ca-8eea-828f98065946 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '.version_select at 0x7f74bce4b670>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:27.823856 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9a2f98a8-d7bd-49ca-8eea-828f98065946 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-881682926" status: 204 len: 0 microversion: 2.20 time: 0.021609 May 17 18:17:27.824602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 375/732] 10.222.0.25 () {60 vars in 1258 bytes} [Tue May 17 18:17:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-881682926 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 18:17:28.456146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-15cddf71-d35c-47c7-89b6-b15d23298d19 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Action: 'create', calling method: .version_select at 0x7f74bcfea160>, body: {"keypair": {"name": "tempest-keypair-953545754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDw05COaXzTSlcaoprwwoR2Hw4AwEiGDXwW/jlude5PE35XnDsy66ufWWm0W/Fl8d/u3dkkFHb/ozPBowV+j0s8meTyuO5c5EB3uEanxS4RP8reHn/HsviyDgdFv+DYSWw=="}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:28.476478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-15cddf71-d35c-47c7-89b6-b15d23298d19 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Getting quotas for project 492389142d804ad392267cb4a728008d. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:28.480320 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-15cddf71-d35c-47c7-89b6-b15d23298d19 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Getting quotas for user 8ba97b67ecf64476a630fd3667d617fb and project 492389142d804ad392267cb4a728008d. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:28.501963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-15cddf71-d35c-47c7-89b6-b15d23298d19 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049683 May 17 18:17:28.502592 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 358/733] 10.222.0.25 () {62 vars in 1199 bytes} [Tue May 17 18:17:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 17 18:17:28.722256 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-3a5087a9-7cb8-4d05-87fd-25ae42f83819 req-c846eb9e-68aa-4e25-856a-cd3d7fdfe527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1966aa90-f5e3-4591-8105-69f6cc0fbdfb", "tag": "c45336db-0e36-4d75-8c9b-f63dc16532f1"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:28.731977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-3a5087a9-7cb8-4d05-87fd-25ae42f83819 req-c846eb9e-68aa-4e25-856a-cd3d7fdfe527 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:28.732138 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-3a5087a9-7cb8-4d05-87fd-25ae42f83819 req-c846eb9e-68aa-4e25-856a-cd3d7fdfe527 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:28.743255 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-3a5087a9-7cb8-4d05-87fd-25ae42f83819 req-c846eb9e-68aa-4e25-856a-cd3d7fdfe527 service nova] Creating event network-changed:c45336db-0e36-4d75-8c9b-f63dc16532f1 for instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb on hv-cinder-84130 May 17 18:17:28.748214 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-3a5087a9-7cb8-4d05-87fd-25ae42f83819 req-c846eb9e-68aa-4e25-856a-cd3d7fdfe527 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029610 May 17 18:17:28.748790 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 376/734] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:29.715448 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1998607489", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2312f304-fc95-4d23-b522-6c0433564246"}], "security_groups": [{"name": "tempest-securitygroup--1677166530"}], "key_name": "tempest-keypair-953545754", "user_data": "}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:29.818843 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] validate_networks() for [('2312f304-fc95-4d23-b522-6c0433564246', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:17:30.178016 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:17:30.178442 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:17:30.178957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:17:30.179370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:17:30.179817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:17:30.188492 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:30.188940 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:30.189824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:30.190262 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:30.206828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Getting quotas for project 492389142d804ad392267cb4a728008d. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:30.211383 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Getting quotas for user 8ba97b67ecf64476a630fd3667d617fb and project 492389142d804ad392267cb4a728008d. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:30.222053 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:17:30.224539 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:17:30.270383 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-50bbf665-82d1-46b6-88b2-a82eb2f276e5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.559734 May 17 18:17:30.271254 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 359/735] 10.222.0.25 () {62 vars in 1187 bytes} [Tue May 17 18:17:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 17 18:17:30.282733 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4b4ee696-7a75-4dc5-a79c-8289a699e6c9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:30.283453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4b4ee696-7a75-4dc5-a79c-8289a699e6c9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:30.338185 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4b4ee696-7a75-4dc5-a79c-8289a699e6c9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:30.345172 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4b4ee696-7a75-4dc5-a79c-8289a699e6c9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:30.346680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4b4ee696-7a75-4dc5-a79c-8289a699e6c9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:30.347777 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4b4ee696-7a75-4dc5-a79c-8289a699e6c9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1281 microversion: 2.20 time: 0.069971 May 17 18:17:30.348620 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 377/736] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:30 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:31.366217 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9cd38d0c-cfbf-435c-9286-e37754e57feb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:31.367170 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9cd38d0c-cfbf-435c-9286-e37754e57feb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:31.375051 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9cd38d0c-cfbf-435c-9286-e37754e57feb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:31.376096 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9cd38d0c-cfbf-435c-9286-e37754e57feb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:31.376881 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9cd38d0c-cfbf-435c-9286-e37754e57feb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:31.377325 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9cd38d0c-cfbf-435c-9286-e37754e57feb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:31.443906 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9cd38d0c-cfbf-435c-9286-e37754e57feb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:31.451769 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9cd38d0c-cfbf-435c-9286-e37754e57feb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:31.453261 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9cd38d0c-cfbf-435c-9286-e37754e57feb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:31.454352 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9cd38d0c-cfbf-435c-9286-e37754e57feb tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1339 microversion: 2.20 time: 0.093029 May 17 18:17:31.454927 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 360/737] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:31 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:32.472158 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5c054ea9-7817-4cdd-bcb7-2e52ecb7b730 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:32.472774 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5c054ea9-7817-4cdd-bcb7-2e52ecb7b730 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:32.480822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5c054ea9-7817-4cdd-bcb7-2e52ecb7b730 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:32.481274 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5c054ea9-7817-4cdd-bcb7-2e52ecb7b730 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:32.482080 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5c054ea9-7817-4cdd-bcb7-2e52ecb7b730 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:32.482524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5c054ea9-7817-4cdd-bcb7-2e52ecb7b730 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:32.675585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5c054ea9-7817-4cdd-bcb7-2e52ecb7b730 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:32.685413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5c054ea9-7817-4cdd-bcb7-2e52ecb7b730 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:32.686956 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5c054ea9-7817-4cdd-bcb7-2e52ecb7b730 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:32.688068 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5c054ea9-7817-4cdd-bcb7-2e52ecb7b730 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1407 microversion: 2.20 time: 0.219939 May 17 18:17:32.698458 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 378/738] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:32 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:32.939177 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-e0c4719d-7cdc-415d-a083-9d9982c7ef95 req-5d46c48a-75bf-4c41-aa88-f770d7a29bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b911090-a501-452a-a039-bb3a83c3055b", "tag": "616eb23c-cba6-4708-a5fb-a61c3ccb7b2c"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:32.950664 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-e0c4719d-7cdc-415d-a083-9d9982c7ef95 req-5d46c48a-75bf-4c41-aa88-f770d7a29bbe service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:32.951120 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-e0c4719d-7cdc-415d-a083-9d9982c7ef95 req-5d46c48a-75bf-4c41-aa88-f770d7a29bbe service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:32.963869 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-e0c4719d-7cdc-415d-a083-9d9982c7ef95 req-5d46c48a-75bf-4c41-aa88-f770d7a29bbe service nova] Creating event network-changed:616eb23c-cba6-4708-a5fb-a61c3ccb7b2c for instance 1b911090-a501-452a-a039-bb3a83c3055b on hv-cinder-84130 May 17 18:17:32.969745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-e0c4719d-7cdc-415d-a083-9d9982c7ef95 req-5d46c48a-75bf-4c41-aa88-f770d7a29bbe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034202 May 17 18:17:32.970345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 361/739] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:33.705205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c7d294ff-67c4-4dad-8591-f137ff53f66c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:33.705820 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c7d294ff-67c4-4dad-8591-f137ff53f66c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:33.712729 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c7d294ff-67c4-4dad-8591-f137ff53f66c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:33.713183 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c7d294ff-67c4-4dad-8591-f137ff53f66c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:33.713956 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c7d294ff-67c4-4dad-8591-f137ff53f66c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:33.714396 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c7d294ff-67c4-4dad-8591-f137ff53f66c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:33.841285 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c7d294ff-67c4-4dad-8591-f137ff53f66c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:33.849533 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c7d294ff-67c4-4dad-8591-f137ff53f66c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:33.851235 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c7d294ff-67c4-4dad-8591-f137ff53f66c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:33.852337 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c7d294ff-67c4-4dad-8591-f137ff53f66c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1407 microversion: 2.20 time: 0.151058 May 17 18:17:33.852906 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 379/740] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:33 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:34.871351 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1694858c-27c3-4ce8-a39b-27e0b6ec3638 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:34.872082 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1694858c-27c3-4ce8-a39b-27e0b6ec3638 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:34.878566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1694858c-27c3-4ce8-a39b-27e0b6ec3638 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:34.879055 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1694858c-27c3-4ce8-a39b-27e0b6ec3638 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:34.879831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1694858c-27c3-4ce8-a39b-27e0b6ec3638 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:34.880298 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1694858c-27c3-4ce8-a39b-27e0b6ec3638 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:35.017398 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1694858c-27c3-4ce8-a39b-27e0b6ec3638 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:35.025909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1694858c-27c3-4ce8-a39b-27e0b6ec3638 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:35.027477 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1694858c-27c3-4ce8-a39b-27e0b6ec3638 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:35.028608 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1694858c-27c3-4ce8-a39b-27e0b6ec3638 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1407 microversion: 2.20 time: 0.162207 May 17 18:17:35.029198 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 362/741] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:34 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:36.046673 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-969c85bb-4d97-4cd2-afec-ed6134467b08 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:36.047280 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-969c85bb-4d97-4cd2-afec-ed6134467b08 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:36.053717 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-969c85bb-4d97-4cd2-afec-ed6134467b08 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:36.054164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-969c85bb-4d97-4cd2-afec-ed6134467b08 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:36.054951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-969c85bb-4d97-4cd2-afec-ed6134467b08 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:36.055383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-969c85bb-4d97-4cd2-afec-ed6134467b08 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:36.184269 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-969c85bb-4d97-4cd2-afec-ed6134467b08 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:36.192061 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-969c85bb-4d97-4cd2-afec-ed6134467b08 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:36.194318 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-969c85bb-4d97-4cd2-afec-ed6134467b08 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:36.195445 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-969c85bb-4d97-4cd2-afec-ed6134467b08 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1407 microversion: 2.20 time: 0.152682 May 17 18:17:36.195999 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 380/742] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:36 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:36.991228 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-6a0d2593-a141-45cd-b53f-183774c15501 req-82e11e8a-fa97-4ab6-8bd5-435c7807dd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b911090-a501-452a-a039-bb3a83c3055b", "name": "network-vif-plugged", "status": "completed", "tag": "616eb23c-cba6-4708-a5fb-a61c3ccb7b2c"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:36.999933 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-6a0d2593-a141-45cd-b53f-183774c15501 req-82e11e8a-fa97-4ab6-8bd5-435c7807dd35 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:37.001303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-6a0d2593-a141-45cd-b53f-183774c15501 req-82e11e8a-fa97-4ab6-8bd5-435c7807dd35 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:37.013072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-6a0d2593-a141-45cd-b53f-183774c15501 req-82e11e8a-fa97-4ab6-8bd5-435c7807dd35 service nova] Creating event network-vif-plugged:616eb23c-cba6-4708-a5fb-a61c3ccb7b2c for instance 1b911090-a501-452a-a039-bb3a83c3055b on hv-cinder-84130 May 17 18:17:37.018056 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-6a0d2593-a141-45cd-b53f-183774c15501 req-82e11e8a-fa97-4ab6-8bd5-435c7807dd35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031679 May 17 18:17:37.018842 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 363/743] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:37.213262 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7d97bc45-c2ab-4c1d-9b41-8ff7a0d2529c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:37.213904 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7d97bc45-c2ab-4c1d-9b41-8ff7a0d2529c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:37.220350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7d97bc45-c2ab-4c1d-9b41-8ff7a0d2529c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:37.220804 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7d97bc45-c2ab-4c1d-9b41-8ff7a0d2529c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:37.221575 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7d97bc45-c2ab-4c1d-9b41-8ff7a0d2529c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:37.222012 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7d97bc45-c2ab-4c1d-9b41-8ff7a0d2529c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:37.350715 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7d97bc45-c2ab-4c1d-9b41-8ff7a0d2529c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:37.360113 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7d97bc45-c2ab-4c1d-9b41-8ff7a0d2529c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:37.361600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7d97bc45-c2ab-4c1d-9b41-8ff7a0d2529c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:37.362835 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7d97bc45-c2ab-4c1d-9b41-8ff7a0d2529c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1407 microversion: 2.20 time: 0.153376 May 17 18:17:37.363391 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 381/744] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:37 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:38.381634 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4520b81b-c1b1-4b07-9646-4f86ef9785d4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:38.382327 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4520b81b-c1b1-4b07-9646-4f86ef9785d4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:38.388979 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4520b81b-c1b1-4b07-9646-4f86ef9785d4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:38.389427 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4520b81b-c1b1-4b07-9646-4f86ef9785d4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:38.390199 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4520b81b-c1b1-4b07-9646-4f86ef9785d4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:38.390663 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4520b81b-c1b1-4b07-9646-4f86ef9785d4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:38.520164 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4520b81b-c1b1-4b07-9646-4f86ef9785d4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:38.528449 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4520b81b-c1b1-4b07-9646-4f86ef9785d4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:38.529942 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4520b81b-c1b1-4b07-9646-4f86ef9785d4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:38.531084 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4520b81b-c1b1-4b07-9646-4f86ef9785d4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1407 microversion: 2.20 time: 0.154342 May 17 18:17:38.531646 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 364/745] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:38 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:39.548904 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7598b3f6-3a23-4f67-9fcd-bab44ae46d5c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:39.549522 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7598b3f6-3a23-4f67-9fcd-bab44ae46d5c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:39.555960 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7598b3f6-3a23-4f67-9fcd-bab44ae46d5c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:39.556404 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7598b3f6-3a23-4f67-9fcd-bab44ae46d5c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:39.557165 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7598b3f6-3a23-4f67-9fcd-bab44ae46d5c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:39.557596 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7598b3f6-3a23-4f67-9fcd-bab44ae46d5c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:39.688493 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7598b3f6-3a23-4f67-9fcd-bab44ae46d5c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:39.697432 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7598b3f6-3a23-4f67-9fcd-bab44ae46d5c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:39.699084 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7598b3f6-3a23-4f67-9fcd-bab44ae46d5c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:39.700287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7598b3f6-3a23-4f67-9fcd-bab44ae46d5c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1599 microversion: 2.20 time: 0.155369 May 17 18:17:39.701084 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 382/746] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:17:39 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:39.718401 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-23024786-8ffb-400d-87d8-74d408d7407e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:39.718975 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-23024786-8ffb-400d-87d8-74d408d7407e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:39.726136 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-23024786-8ffb-400d-87d8-74d408d7407e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:39.726628 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-23024786-8ffb-400d-87d8-74d408d7407e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:39.727410 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-23024786-8ffb-400d-87d8-74d408d7407e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:39.727854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-23024786-8ffb-400d-87d8-74d408d7407e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:39.811187 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-23024786-8ffb-400d-87d8-74d408d7407e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096522 May 17 18:17:39.811780 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 365/747] 10.222.0.25 () {60 vars in 1315 bytes} [Tue May 17 18:17:39 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:17:40.724942 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-31f2033b-d9ec-43d6-9e46-9fe0ac069ed3 req-81adba06-fa72-4975-aee5-b9203b1e10fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b911090-a501-452a-a039-bb3a83c3055b", "tag": "616eb23c-cba6-4708-a5fb-a61c3ccb7b2c"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:40.733208 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-31f2033b-d9ec-43d6-9e46-9fe0ac069ed3 req-81adba06-fa72-4975-aee5-b9203b1e10fc service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:40.733665 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-31f2033b-d9ec-43d6-9e46-9fe0ac069ed3 req-81adba06-fa72-4975-aee5-b9203b1e10fc service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:40.744415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-31f2033b-d9ec-43d6-9e46-9fe0ac069ed3 req-81adba06-fa72-4975-aee5-b9203b1e10fc service nova] Creating event network-changed:616eb23c-cba6-4708-a5fb-a61c3ccb7b2c for instance 1b911090-a501-452a-a039-bb3a83c3055b on hv-cinder-84130 May 17 18:17:40.749487 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-31f2033b-d9ec-43d6-9e46-9fe0ac069ed3 req-81adba06-fa72-4975-aee5-b9203b1e10fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028303 May 17 18:17:40.750175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 383/748] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:49.191344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2a44faf4-9f89-4938-84c8-55055961a776 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:49.191928 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2a44faf4-9f89-4938-84c8-55055961a776 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:49.198280 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a44faf4-9f89-4938-84c8-55055961a776 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:49.198777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a44faf4-9f89-4938-84c8-55055961a776 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:49.199550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a44faf4-9f89-4938-84c8-55055961a776 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:49.199996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a44faf4-9f89-4938-84c8-55055961a776 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:49.222694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2a44faf4-9f89-4938-84c8-55055961a776 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/ips" status: 200 len: 150 microversion: 2.1 time: 0.035658 May 17 18:17:49.223749 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 366/749] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 17 18:17:49 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:50.528941 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e8b68e1a-79f5-4253-bc91-e51bb228b0a1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3907f364-04e1-49ec-88f5-6b3111936c6d"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:50.530075 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e8b68e1a-79f5-4253-bc91-e51bb228b0a1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:50.536743 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e8b68e1a-79f5-4253-bc91-e51bb228b0a1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:50.537222 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e8b68e1a-79f5-4253-bc91-e51bb228b0a1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:50.537984 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e8b68e1a-79f5-4253-bc91-e51bb228b0a1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:50.538442 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e8b68e1a-79f5-4253-bc91-e51bb228b0a1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:50.951082 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e8b68e1a-79f5-4253-bc91-e51bb228b0a1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426791 May 17 18:17:50.951686 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 384/750] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:17:50 2022] POST /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:57.530485 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-100b55ea-c1a1-4bab-b47e-e36286f3f116 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:57.531445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-100b55ea-c1a1-4bab-b47e-e36286f3f116 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:57.538043 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-100b55ea-c1a1-4bab-b47e-e36286f3f116 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:57.538498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-100b55ea-c1a1-4bab-b47e-e36286f3f116 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:57.539552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-100b55ea-c1a1-4bab-b47e-e36286f3f116 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:57.539997 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-100b55ea-c1a1-4bab-b47e-e36286f3f116 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:57.569288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-100b55ea-c1a1-4bab-b47e-e36286f3f116 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043650 May 17 18:17:57.569852 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 367/751] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:17:57 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:17:57.626975 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e0d8a80a-5677-4c29-b093-443d48de3a83 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:57.627488 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e0d8a80a-5677-4c29-b093-443d48de3a83 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:57.634102 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e0d8a80a-5677-4c29-b093-443d48de3a83 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:57.634549 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e0d8a80a-5677-4c29-b093-443d48de3a83 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:57.635332 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e0d8a80a-5677-4c29-b093-443d48de3a83 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:57.635769 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e0d8a80a-5677-4c29-b093-443d48de3a83 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:57.660188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e0d8a80a-5677-4c29-b093-443d48de3a83 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:17:57.734242 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e0d8a80a-5677-4c29-b093-443d48de3a83 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 204 len: 0 microversion: 2.1 time: 0.111534 May 17 18:17:57.735024 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 385/752] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:17:57 2022] DELETE /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:17:57.744438 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-87aa8ef4-803f-4acf-bb61-aaf2988df5a0 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:57.745094 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-87aa8ef4-803f-4acf-bb61-aaf2988df5a0 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:57.750994 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-87aa8ef4-803f-4acf-bb61-aaf2988df5a0 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:57.751449 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-87aa8ef4-803f-4acf-bb61-aaf2988df5a0 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:57.752218 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-87aa8ef4-803f-4acf-bb61-aaf2988df5a0 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:57.752665 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-87aa8ef4-803f-4acf-bb61-aaf2988df5a0 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:57.976234 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-87aa8ef4-803f-4acf-bb61-aaf2988df5a0 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:57.983634 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-87aa8ef4-803f-4acf-bb61-aaf2988df5a0 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1676 microversion: 2.1 time: 0.243099 May 17 18:17:57.984197 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 368/753] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:57 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:58.516573 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a1b33d74-da24-46f8-a656-a40cc446691c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3907f364-04e1-49ec-88f5-6b3111936c6d"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:58.517728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a1b33d74-da24-46f8-a656-a40cc446691c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:58.524859 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a1b33d74-da24-46f8-a656-a40cc446691c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.525308 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a1b33d74-da24-46f8-a656-a40cc446691c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.526075 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a1b33d74-da24-46f8-a656-a40cc446691c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.526513 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a1b33d74-da24-46f8-a656-a40cc446691c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.762868 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-a1b33d74-da24-46f8-a656-a40cc446691c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Invalid volume: volume 3907f364-04e1-49ec-88f5-6b3111936c6d is already attached to instances: 7e4705dd-6079-47f8-9525-79f5ae7b678b May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a1b33d74-da24-46f8-a656-a40cc446691c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: POST /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments HTTP/1.1 May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 74 May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:17:58.764567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {"volumeAttachment": {"volumeId": "3907f364-04e1-49ec-88f5-6b3111936c6d"}} May 17 18:17:58.766159 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Invalid volume: volume 3907f364-04e1-49ec-88f5-6b3111936c6d is already attached to instances: 7e4705dd-6079-47f8-9525-79f5ae7b678b May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'server_id': '7e4705dd-6079-47f8-9525-79f5ae7b678b', 'body': {'volumeAttachment': {'volumeId': '3907f364-04e1-49ec-88f5-6b3111936c6d'}}} May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3907f364-04e1-49ec-88f5-6b3111936c6d is already attached to instances: 7e4705dd-6079-47f8-9525-79f5ae7b678b May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:17:58.767107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3907f364-04e1-49ec-88f5-6b3111936c6d is already attached to instances: 7e4705dd-6079-47f8-9525-79f5ae7b678b May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:58.768527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:58.770539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:58.770539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:17:58.770539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:17:58.770539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3907f364-04e1-49ec-88f5-6b3111936c6d is already attached to instances: 7e4705dd-6079-47f8-9525-79f5ae7b678b May 17 18:17:58.770539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:17:58.770539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a1b33d74-da24-46f8-a656-a40cc446691c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 400 to user: Invalid volume: volume 3907f364-04e1-49ec-88f5-6b3111936c6d is already attached to instances: 7e4705dd-6079-47f8-9525-79f5ae7b678b {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:17:58.770539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a1b33d74-da24-46f8-a656-a40cc446691c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.253736 May 17 18:17:58.770539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 386/754] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:17:58 2022] POST /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments => generated 174 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 18:17:58.824514 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c6b8f21a-8cff-4838-96a6-6a69c1e36c60 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:58.825025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c6b8f21a-8cff-4838-96a6-6a69c1e36c60 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:58.831577 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c6b8f21a-8cff-4838-96a6-6a69c1e36c60 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.832027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c6b8f21a-8cff-4838-96a6-6a69c1e36c60 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.833335 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c6b8f21a-8cff-4838-96a6-6a69c1e36c60 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.833766 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c6b8f21a-8cff-4838-96a6-6a69c1e36c60 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.912902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-c6b8f21a-8cff-4838-96a6-6a69c1e36c60 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lazy-loading 'services' on Instance uuid 7e4705dd-6079-47f8-9525-79f5ae7b678b {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:17:58.981490 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c6b8f21a-8cff-4838-96a6-6a69c1e36c60 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments/3907f364-04e1-49ec-88f5-6b3111936c6d" status: 202 len: 0 microversion: 2.1 time: 0.160748 May 17 18:17:58.982067 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 369/755] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:17:58 2022] DELETE /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments/3907f364-04e1-49ec-88f5-6b3111936c6d => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:17:58.990680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3c605e2e-b171-4a5c-aa74-79c5474379f1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:58.991602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3c605e2e-b171-4a5c-aa74-79c5474379f1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:58.998443 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3c605e2e-b171-4a5c-aa74-79c5474379f1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.998925 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3c605e2e-b171-4a5c-aa74-79c5474379f1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.999698 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3c605e2e-b171-4a5c-aa74-79c5474379f1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:59.000131 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3c605e2e-b171-4a5c-aa74-79c5474379f1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:59.001220 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0efa5441-cda5-42b7-8d05-40e5e8e86421 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:59.002015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0efa5441-cda5-42b7-8d05-40e5e8e86421 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:59.008976 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0efa5441-cda5-42b7-8d05-40e5e8e86421 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:59.009432 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0efa5441-cda5-42b7-8d05-40e5e8e86421 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:59.010200 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0efa5441-cda5-42b7-8d05-40e5e8e86421 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:59.010674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0efa5441-cda5-42b7-8d05-40e5e8e86421 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:59.029100 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3c605e2e-b171-4a5c-aa74-79c5474379f1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042797 May 17 18:17:59.029845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 387/756] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:17:58 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:59.138652 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0efa5441-cda5-42b7-8d05-40e5e8e86421 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:59.146475 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0efa5441-cda5-42b7-8d05-40e5e8e86421 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1676 microversion: 2.1 time: 0.149629 May 17 18:17:59.147121 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 370/757] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:17:58 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:00.039946 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c201b1ac-9e81-4496-a978-9af44c0770c3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:00.040852 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c201b1ac-9e81-4496-a978-9af44c0770c3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:00.047188 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c201b1ac-9e81-4496-a978-9af44c0770c3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.047635 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c201b1ac-9e81-4496-a978-9af44c0770c3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.048396 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c201b1ac-9e81-4496-a978-9af44c0770c3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.048827 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c201b1ac-9e81-4496-a978-9af44c0770c3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.078013 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c201b1ac-9e81-4496-a978-9af44c0770c3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 May 17 18:18:00.078545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 388/758] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:18:00 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:00.163864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-cf02fff7-10c5-451f-b29b-8797b3414740 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:00.164506 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-cf02fff7-10c5-451f-b29b-8797b3414740 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:00.170917 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cf02fff7-10c5-451f-b29b-8797b3414740 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.171404 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cf02fff7-10c5-451f-b29b-8797b3414740 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.172176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cf02fff7-10c5-451f-b29b-8797b3414740 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.172624 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cf02fff7-10c5-451f-b29b-8797b3414740 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.304008 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-cf02fff7-10c5-451f-b29b-8797b3414740 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:00.312006 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-cf02fff7-10c5-451f-b29b-8797b3414740 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1676 microversion: 2.1 time: 0.152411 May 17 18:18:00.312578 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 371/759] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:00 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:01.089767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5fbdd9dc-6feb-4a94-a141-b0032d67685b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:01.090720 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5fbdd9dc-6feb-4a94-a141-b0032d67685b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:01.097011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5fbdd9dc-6feb-4a94-a141-b0032d67685b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.097463 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5fbdd9dc-6feb-4a94-a141-b0032d67685b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.098558 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5fbdd9dc-6feb-4a94-a141-b0032d67685b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.098768 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5fbdd9dc-6feb-4a94-a141-b0032d67685b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.128827 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5fbdd9dc-6feb-4a94-a141-b0032d67685b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042968 May 17 18:18:01.137197 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 389/760] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:18:01 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:18:01.198292 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-2881f2f2-ab3a-4d44-9ff2-521600ce7f94 req-aa9ae1d8-ba35-4e18-88a6-ace534ec84ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7", "name": "network-vif-deleted", "tag": "00461b29-1b83-4cbe-b27b-1a409ac59ea0"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:01.229778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ab291ae6-2c2a-461c-a602-a2b088b6a9fa tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:01.230415 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-2881f2f2-ab3a-4d44-9ff2-521600ce7f94 req-aa9ae1d8-ba35-4e18-88a6-ace534ec84ef service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.230944 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ab291ae6-2c2a-461c-a602-a2b088b6a9fa tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:01.231690 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-2881f2f2-ab3a-4d44-9ff2-521600ce7f94 req-aa9ae1d8-ba35-4e18-88a6-ace534ec84ef service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.241194 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab291ae6-2c2a-461c-a602-a2b088b6a9fa tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.241967 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab291ae6-2c2a-461c-a602-a2b088b6a9fa tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.242993 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab291ae6-2c2a-461c-a602-a2b088b6a9fa tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.243791 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab291ae6-2c2a-461c-a602-a2b088b6a9fa tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.270279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-2881f2f2-ab3a-4d44-9ff2-521600ce7f94 req-aa9ae1d8-ba35-4e18-88a6-ace534ec84ef service nova] Creating event network-vif-deleted:00461b29-1b83-4cbe-b27b-1a409ac59ea0 for instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 on hv-cinder-84130 May 17 18:18:01.271326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ab291ae6-2c2a-461c-a602-a2b088b6a9fa tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:18:01.284169 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-2881f2f2-ab3a-4d44-9ff2-521600ce7f94 req-aa9ae1d8-ba35-4e18-88a6-ace534ec84ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093073 May 17 18:18:01.286124 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 372/761] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:01.336146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:01.337335 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:01.347380 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.348547 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.349938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.358119 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.413047 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ab291ae6-2c2a-461c-a602-a2b088b6a9fa tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 204 len: 0 microversion: 2.1 time: 0.186816 May 17 18:18:01.414900 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 390/762] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:18:01 2022] DELETE /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:18:01.428614 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-cb51b62e-343b-40c1-9ab9-9b3e3c281f94 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:01.429788 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-cb51b62e-343b-40c1-9ab9-9b3e3c281f94 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:01.438496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cb51b62e-343b-40c1-9ab9-9b3e3c281f94 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.438987 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cb51b62e-343b-40c1-9ab9-9b3e3c281f94 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.440596 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cb51b62e-343b-40c1-9ab9-9b3e3c281f94 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.441833 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cb51b62e-343b-40c1-9ab9-9b3e3c281f94 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.442220 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.443259 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.444265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lazy-loading 'fault' on Instance uuid dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:18:01.507783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:01.515989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-19f66d56-3c41-450c-ba89-67fcccb1c61e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1328 microversion: 2.1 time: 0.189076 May 17 18:18:01.517829 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 373/763] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:01 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:01.614753 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-cb51b62e-343b-40c1-9ab9-9b3e3c281f94 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:01.622117 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-cb51b62e-343b-40c1-9ab9-9b3e3c281f94 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1681 microversion: 2.1 time: 0.200922 May 17 18:18:01.622701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 391/764] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:01 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:02.534204 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:02.534840 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:02.541726 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.542181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.542974 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.543416 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.573491 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.573944 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.574393 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lazy-loading 'fault' on Instance uuid dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:18:02.614873 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:02.622134 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2d939b77-5480-4364-aec4-509fb8b283ac tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 200 len: 1328 microversion: 2.1 time: 0.091834 May 17 18:18:02.622735 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 374/765] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:02 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 1328 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:02.639582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-06682230-94f0-4795-9487-715d355d3f16 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:02.640191 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-06682230-94f0-4795-9487-715d355d3f16 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:02.646504 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-06682230-94f0-4795-9487-715d355d3f16 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.646988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-06682230-94f0-4795-9487-715d355d3f16 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.647747 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-06682230-94f0-4795-9487-715d355d3f16 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.648181 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-06682230-94f0-4795-9487-715d355d3f16 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.781785 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-06682230-94f0-4795-9487-715d355d3f16 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:02.790010 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-06682230-94f0-4795-9487-715d355d3f16 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1681 microversion: 2.1 time: 0.154187 May 17 18:18:02.790516 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 392/766] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:02 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:03.639002 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-764e87ec-f111-4366-a177-19de6930db8b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:03.639593 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-764e87ec-f111-4366-a177-19de6930db8b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:03.645805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-764e87ec-f111-4366-a177-19de6930db8b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.646253 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-764e87ec-f111-4366-a177-19de6930db8b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:03.647042 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-764e87ec-f111-4366-a177-19de6930db8b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.647482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-764e87ec-f111-4366-a177-19de6930db8b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:03.660816 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-764e87ec-f111-4366-a177-19de6930db8b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] HTTP exception thrown: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-764e87ec-f111-4366-a177-19de6930db8b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Request method failure captured: May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 HTTP/1.1 May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WwrK1zhQPlNa0O5rU9u5rx4UpWlmG6bI1E4WoakKVpT4nD2EzSnM0QqKXRSQyYhmXL5BYVE6TSYETf2FtlhukT27kePUlnRi8fVmocTgsQhii7m58J-RKq3pLrRvfH2i_eNNCvHH4YoevVmaK4XhJQ5rqhXziWDPIYxutWIlyHPME May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: c087a662f09843faa87b942c9462ec67 May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:18:03.662452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c087a662f09843faa87b942c9462ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c087a662f09843faa87b942c9462ec67", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeTestJSON-1557935859 May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: c087a662f09843faa87b942c9462ec67 May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 17c2097983df461eb7c23bc0ed7b7520 May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:18:03.663941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': 'dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7'} May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:03.664755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:18:03.666009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:03.667166 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-764e87ec-f111-4366-a177-19de6930db8b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Returning 404 to user: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:03.667166 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-764e87ec-f111-4366-a177-19de6930db8b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 404 len: 111 microversion: 2.1 time: 0.028755 May 17 18:18:03.667166 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 375/767] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:03 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:03.672709 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f06b4bc6-c01f-48fe-8471-f1311e906a85 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '.version_select at 0x7f74bce28e50>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:03.690542 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f06b4bc6-c01f-48fe-8471-f1311e906a85 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302056829" status: 202 len: 0 microversion: 2.1 time: 0.021546 May 17 18:18:03.691166 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 393/768] 10.222.0.25 () {58 vars in 1220 bytes} [Tue May 17 18:18:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302056829 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:18:03.807701 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c4d3894d-8f46-4f18-9648-c38464aa780a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:03.808249 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c4d3894d-8f46-4f18-9648-c38464aa780a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:03.815382 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c4d3894d-8f46-4f18-9648-c38464aa780a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.816344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c4d3894d-8f46-4f18-9648-c38464aa780a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:03.818498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c4d3894d-8f46-4f18-9648-c38464aa780a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.819263 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c4d3894d-8f46-4f18-9648-c38464aa780a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:04.038174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c4d3894d-8f46-4f18-9648-c38464aa780a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:04.045846 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c4d3894d-8f46-4f18-9648-c38464aa780a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 200 len: 1681 microversion: 2.1 time: 0.242110 May 17 18:18:04.047050 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 376/769] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:03 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:04.256803 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-f2e312d2-c27e-4734-b16f-a907de03adfb req-064902ea-557f-4552-884f-d6be34bb3123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4705dd-6079-47f8-9525-79f5ae7b678b", "name": "network-vif-deleted", "tag": "31820f25-c56a-4bd2-a9a0-28fc3bd82bb2"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:04.270954 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-f2e312d2-c27e-4734-b16f-a907de03adfb req-064902ea-557f-4552-884f-d6be34bb3123 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:04.271416 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-f2e312d2-c27e-4734-b16f-a907de03adfb req-064902ea-557f-4552-884f-d6be34bb3123 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:04.283726 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-f2e312d2-c27e-4734-b16f-a907de03adfb req-064902ea-557f-4552-884f-d6be34bb3123 service nova] Creating event network-vif-deleted:31820f25-c56a-4bd2-a9a0-28fc3bd82bb2 for instance 7e4705dd-6079-47f8-9525-79f5ae7b678b on hv-cinder-84130 May 17 18:18:04.289784 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-f2e312d2-c27e-4734-b16f-a907de03adfb req-064902ea-557f-4552-884f-d6be34bb3123 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036728 May 17 18:18:04.290973 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 394/770] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:04.338697 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a8883ca4-df4b-4c40-a700-1b402aeb838e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'create', calling method: .version_select at 0x7f74abcb3430>, body: {"keypair": {"name": "tempest-keypair-1229460090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa4/BmbnHp1vHHjebVQdm3KpGOGqzvsqXDJqld3GeIGWXztO5ewQsluPSDsaMmv/nj1TZuiOzJU6hQepeUcPqTVHIUvEK+U8P/qyLYoBJnw8FHc6Hzb6pNCH58TNbhGsA=="}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:04.355149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-a8883ca4-df4b-4c40-a700-1b402aeb838e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Getting quotas for project c087a662f09843faa87b942c9462ec67. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:18:04.360499 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-a8883ca4-df4b-4c40-a700-1b402aeb838e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Getting quotas for user 17c2097983df461eb7c23bc0ed7b7520 and project c087a662f09843faa87b942c9462ec67. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:18:04.395740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a8883ca4-df4b-4c40-a700-1b402aeb838e tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059639 May 17 18:18:04.397511 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 377/771] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 17 18:18:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:05.065744 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b155a495-dc7c-41a9-84dc-3d3ec7eadd45 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:05.067298 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b155a495-dc7c-41a9-84dc-3d3ec7eadd45 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:05.074554 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b155a495-dc7c-41a9-84dc-3d3ec7eadd45 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.075122 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b155a495-dc7c-41a9-84dc-3d3ec7eadd45 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.075836 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b155a495-dc7c-41a9-84dc-3d3ec7eadd45 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.076281 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b155a495-dc7c-41a9-84dc-3d3ec7eadd45 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.099093 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-b155a495-dc7c-41a9-84dc-3d3ec7eadd45 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b155a495-dc7c-41a9-84dc-3d3ec7eadd45 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b HTTP/1.1 May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:18:05.101988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:18:05.103397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '7e4705dd-6079-47f8-9525-79f5ae7b678b'} May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:05.104139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:18:05.105306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:05.106382 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b155a495-dc7c-41a9-84dc-3d3ec7eadd45 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:05.106382 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b155a495-dc7c-41a9-84dc-3d3ec7eadd45 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 404 len: 111 microversion: 2.1 time: 0.043039 May 17 18:18:05.106382 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 395/772] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:05 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:05.112912 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-40f6df42-0cc8-4856-967c-f8d612c32975 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '.version_select at 0x7f74abcaadc0>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:05.133325 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-40f6df42-0cc8-4856-967c-f8d612c32975 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061793064" status: 202 len: 0 microversion: 2.1 time: 0.023948 May 17 18:18:05.133927 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 378/773] 10.222.0.25 () {58 vars in 1220 bytes} [Tue May 17 18:18:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061793064 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:18:05.470433 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3364f4b7-5673-4a2c-837c-b9f684ef7baa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:05.470991 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3364f4b7-5673-4a2c-837c-b9f684ef7baa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:05.477260 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3364f4b7-5673-4a2c-837c-b9f684ef7baa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.477712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3364f4b7-5673-4a2c-837c-b9f684ef7baa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.478491 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3364f4b7-5673-4a2c-837c-b9f684ef7baa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.478947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3364f4b7-5673-4a2c-837c-b9f684ef7baa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.570435 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-3364f4b7-5673-4a2c-837c-b9f684ef7baa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lazy-loading 'services' on Instance uuid 1966aa90-f5e3-4591-8105-69f6cc0fbdfb {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:18:05.650705 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3364f4b7-5673-4a2c-837c-b9f684ef7baa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments/32bacdf1-a92f-4167-a3ae-c052d1de4843" status: 202 len: 0 microversion: 2.1 time: 0.183204 May 17 18:18:05.651597 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 396/774] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:18:05 2022] DELETE /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments/32bacdf1-a92f-4167-a3ae-c052d1de4843 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:18:05.662131 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8c5fe6aa-d4c9-443b-81ea-f85e31d2f40e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:05.663114 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8c5fe6aa-d4c9-443b-81ea-f85e31d2f40e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:05.673172 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8c5fe6aa-d4c9-443b-81ea-f85e31d2f40e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.673768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8c5fe6aa-d4c9-443b-81ea-f85e31d2f40e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.674887 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8c5fe6aa-d4c9-443b-81ea-f85e31d2f40e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.676884 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8c5fe6aa-d4c9-443b-81ea-f85e31d2f40e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.743987 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8c5fe6aa-d4c9-443b-81ea-f85e31d2f40e tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087682 May 17 18:18:05.745066 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 379/775] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:18:05 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:05.802644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6dd300a3-cef6-463b-9d57-e71d1ead2d1c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: .version_select at 0x7f74bcdf5310>, body: {"keypair": {"name": "tempest-keypair-722135440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6Gdt1Wprnza/fUznl+hKi9N5mj/lI8wAId7Up0RgRUirrNYx8XVOltH7+aQwVyhDyFHXjPuq12d1/wHKVrhRdRPfIufovjvx0Hq35uVY8V4MEoytxsCzgdOCk3/Ds3EQ=="}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:05.816158 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-6dd300a3-cef6-463b-9d57-e71d1ead2d1c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:18:05.820983 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-6dd300a3-cef6-463b-9d57-e71d1ead2d1c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for user c7b641ce301a4b7685f0f70d7ac4a5d3 and project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:18:05.824597 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2095822685", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0e67a0c-2bb4-4c55-8fbd-692a7edee27d"}], "security_groups": [{"name": "tempest-securitygroup--160914790"}], "key_name": "tempest-keypair-1229460090", "user_data": "}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:05.842951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6dd300a3-cef6-463b-9d57-e71d1ead2d1c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044937 May 17 18:18:05.843890 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 397/776] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 17 18:18:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:05.932041 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] validate_networks() for [('b0e67a0c-2bb4-4c55-8fbd-692a7edee27d', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:18:06.379785 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:18:06.380412 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:18:06.380702 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:18:06.381259 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:18:06.381715 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:18:06.392664 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.393122 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.393987 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.394471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.411487 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Getting quotas for project c087a662f09843faa87b942c9462ec67. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:18:06.416532 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Getting quotas for user 17c2097983df461eb7c23bc0ed7b7520 and project c087a662f09843faa87b942c9462ec67. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:18:06.428625 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:18:06.431167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:18:06.482762 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-79091685-52c6-40a6-ae6c-af597cd3c72b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.662320 May 17 18:18:06.483410 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 380/777] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:18:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 18:18:06.494879 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-367a976a-f0bc-4279-8a10-ab5785c80a44 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:06.496432 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-367a976a-f0bc-4279-8a10-ab5785c80a44 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:06.560281 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-367a976a-f0bc-4279-8a10-ab5785c80a44 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:06.568154 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-367a976a-f0bc-4279-8a10-ab5785c80a44 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1238 microversion: 2.1 time: 0.077328 May 17 18:18:06.568967 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 398/778] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:06 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:06.756891 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2007b7d8-0699-4311-8d3d-d1ca2b69aeba tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:06.758266 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2007b7d8-0699-4311-8d3d-d1ca2b69aeba tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:06.766034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2007b7d8-0699-4311-8d3d-d1ca2b69aeba tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.766612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2007b7d8-0699-4311-8d3d-d1ca2b69aeba tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.767529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2007b7d8-0699-4311-8d3d-d1ca2b69aeba tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.768066 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2007b7d8-0699-4311-8d3d-d1ca2b69aeba tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.797481 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2007b7d8-0699-4311-8d3d-d1ca2b69aeba tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045463 May 17 18:18:06.798231 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 381/779] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:18:06 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:18:06.875653 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-86667afb-b90e-4aed-ad9d-edccb2e9479a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:06.876544 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-86667afb-b90e-4aed-ad9d-edccb2e9479a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:06.884850 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-86667afb-b90e-4aed-ad9d-edccb2e9479a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.885502 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-86667afb-b90e-4aed-ad9d-edccb2e9479a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.886440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-86667afb-b90e-4aed-ad9d-edccb2e9479a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.887041 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-86667afb-b90e-4aed-ad9d-edccb2e9479a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.914305 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-86667afb-b90e-4aed-ad9d-edccb2e9479a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:18:07.017611 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-86667afb-b90e-4aed-ad9d-edccb2e9479a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 204 len: 0 microversion: 2.1 time: 0.146912 May 17 18:18:07.019359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 399/780] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:18:06 2022] DELETE /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:18:07.031081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-693296a6-9c73-4e4c-834f-6c604b0b3761 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:07.031081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-693296a6-9c73-4e4c-834f-6c604b0b3761 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:07.037721 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-693296a6-9c73-4e4c-834f-6c604b0b3761 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.038186 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-693296a6-9c73-4e4c-834f-6c604b0b3761 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.039007 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-693296a6-9c73-4e4c-834f-6c604b0b3761 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.039456 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-693296a6-9c73-4e4c-834f-6c604b0b3761 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.074911 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1427584379", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc022e51-2bed-4b09-b828-c8708bb8de4d"}], "security_groups": [{"name": "tempest-securitygroup--1691339649"}], "key_name": "tempest-keypair-722135440", "user_data": "}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:07.203734 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-693296a6-9c73-4e4c-834f-6c604b0b3761 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:07.206347 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.network.neutron [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] validate_networks() for [('bc022e51-2bed-4b09-b828-c8708bb8de4d', None, None, None, None, None)] {{(pid=117021) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:18:07.211172 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-693296a6-9c73-4e4c-834f-6c604b0b3761 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1690 microversion: 2.1 time: 0.186797 May 17 18:18:07.211820 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 382/781] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:07 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:07.610200 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Flavor limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:18:07.610716 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Image limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:18:07.611200 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Flavor pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:18:07.611614 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Image pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:18:07.612027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:18:07.621178 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.621636 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.622448 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.622929 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.639086 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-05cdae19-e673-4ff6-9c56-a7c83e93129b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:07.639707 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-05cdae19-e673-4ff6-9c56-a7c83e93129b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:07.641205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:18:07.645193 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Getting quotas for user c7b641ce301a4b7685f0f70d7ac4a5d3 and project 4475ac01e59d43438b45bc5fc01fb00b. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:18:07.645771 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05cdae19-e673-4ff6-9c56-a7c83e93129b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.646233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05cdae19-e673-4ff6-9c56-a7c83e93129b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.647040 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05cdae19-e673-4ff6-9c56-a7c83e93129b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.647486 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-05cdae19-e673-4ff6-9c56-a7c83e93129b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.656004 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Going to run 1 instances... {{(pid=117021) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:18:07.658359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:18:07.708190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b027ed85-a505-4d83-8489-a3c5ac01b558 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.637850 May 17 18:18:07.708837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 400/782] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:18:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 18:18:07.716680 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-05cdae19-e673-4ff6-9c56-a7c83e93129b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:07.719368 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-41435d5c-52be-40e9-be36-a153d9d62ae2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:07.720102 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-41435d5c-52be-40e9-be36-a153d9d62ae2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:07.724562 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-05cdae19-e673-4ff6-9c56-a7c83e93129b tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1242 microversion: 2.1 time: 0.143828 May 17 18:18:07.731195 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 383/783] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:07 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1242 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:07.777153 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-41435d5c-52be-40e9-be36-a153d9d62ae2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:07.784280 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-41435d5c-52be-40e9-be36-a153d9d62ae2 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1241 microversion: 2.1 time: 0.068611 May 17 18:18:07.789385 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 401/784] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:07 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:08.277233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a802a9b3-06be-49a3-a918-b54be748818f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:08.277915 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a802a9b3-06be-49a3-a918-b54be748818f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:08.283892 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a802a9b3-06be-49a3-a918-b54be748818f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.284366 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a802a9b3-06be-49a3-a918-b54be748818f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.285192 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a802a9b3-06be-49a3-a918-b54be748818f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.285631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a802a9b3-06be-49a3-a918-b54be748818f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.411068 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a802a9b3-06be-49a3-a918-b54be748818f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:08.418199 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a802a9b3-06be-49a3-a918-b54be748818f tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1690 microversion: 2.1 time: 0.194816 May 17 18:18:08.418808 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 384/785] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:08 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:08.743389 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-94897524-e9ae-4e65-8716-e856ae5268c6 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:08.743389 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-94897524-e9ae-4e65-8716-e856ae5268c6 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:08.749200 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-94897524-e9ae-4e65-8716-e856ae5268c6 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.749655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-94897524-e9ae-4e65-8716-e856ae5268c6 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.750433 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-94897524-e9ae-4e65-8716-e856ae5268c6 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.750902 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-94897524-e9ae-4e65-8716-e856ae5268c6 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.801657 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0e42f5aa-cb16-4251-9780-7ac436f9adc1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:08.802400 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0e42f5aa-cb16-4251-9780-7ac436f9adc1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:08.808399 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0e42f5aa-cb16-4251-9780-7ac436f9adc1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.808861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0e42f5aa-cb16-4251-9780-7ac436f9adc1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.809637 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0e42f5aa-cb16-4251-9780-7ac436f9adc1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.810077 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0e42f5aa-cb16-4251-9780-7ac436f9adc1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.815570 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-94897524-e9ae-4e65-8716-e856ae5268c6 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:08.823142 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-94897524-e9ae-4e65-8716-e856ae5268c6 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1242 microversion: 2.1 time: 0.085827 May 17 18:18:08.823700 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 402/786] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:08 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:08.869922 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0e42f5aa-cb16-4251-9780-7ac436f9adc1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:08.877240 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0e42f5aa-cb16-4251-9780-7ac436f9adc1 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1245 microversion: 2.1 time: 0.079884 May 17 18:18:08.877809 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 385/787] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:08 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:09.106513 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-68975c99-ce6b-4964-b507-eed4fd2eee45 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-379291499"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:09.107075 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-68975c99-ce6b-4964-b507-eed4fd2eee45 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:09.114219 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-68975c99-ce6b-4964-b507-eed4fd2eee45 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.114695 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-68975c99-ce6b-4964-b507-eed4fd2eee45 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.115464 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-68975c99-ce6b-4964-b507-eed4fd2eee45 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.115895 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-68975c99-ce6b-4964-b507-eed4fd2eee45 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.250816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.network.security_group_api [None req-68975c99-ce6b-4964-b507-eed4fd2eee45 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Removing security group 4a4e1f56-a92d-40f3-b054-4b31de1b4ce3 from port a29d526a-3dbb-4880-84ae-f0ec2191f0e2 May 17 18:18:09.436887 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f9ef4ca5-981c-475a-97a6-b80f57db20a7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:09.437603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f9ef4ca5-981c-475a-97a6-b80f57db20a7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:09.444581 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f9ef4ca5-981c-475a-97a6-b80f57db20a7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.445063 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f9ef4ca5-981c-475a-97a6-b80f57db20a7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.445836 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f9ef4ca5-981c-475a-97a6-b80f57db20a7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.446442 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f9ef4ca5-981c-475a-97a6-b80f57db20a7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.671795 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f9ef4ca5-981c-475a-97a6-b80f57db20a7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:09.679921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f9ef4ca5-981c-475a-97a6-b80f57db20a7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1690 microversion: 2.1 time: 0.247910 May 17 18:18:09.680501 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 386/788] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:09 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1690 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:09.760328 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-68975c99-ce6b-4964-b507-eed4fd2eee45 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "POST /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/action" status: 202 len: 0 microversion: 2.1 time: 0.657518 May 17 18:18:09.767415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 403/789] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:18:09 2022] POST /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:18:09.775027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-5ea91c4a-d947-4d0c-975e-9caea2d76735 req-3c9621fc-1c15-4eac-a1ed-5dd8c0f697d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5792551b-b2ce-425d-9831-77b469c883c8", "tag": "a29d526a-3dbb-4880-84ae-f0ec2191f0e2"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:09.788090 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-5ea91c4a-d947-4d0c-975e-9caea2d76735 req-3c9621fc-1c15-4eac-a1ed-5dd8c0f697d9 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.788815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-5ea91c4a-d947-4d0c-975e-9caea2d76735 req-3c9621fc-1c15-4eac-a1ed-5dd8c0f697d9 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.809277 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-5ea91c4a-d947-4d0c-975e-9caea2d76735 req-3c9621fc-1c15-4eac-a1ed-5dd8c0f697d9 service nova] Creating event network-changed:a29d526a-3dbb-4880-84ae-f0ec2191f0e2 for instance 5792551b-b2ce-425d-9831-77b469c883c8 on hv-cinder-84130 May 17 18:18:09.815991 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-5ea91c4a-d947-4d0c-975e-9caea2d76735 req-3c9621fc-1c15-4eac-a1ed-5dd8c0f697d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046234 May 17 18:18:09.817780 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 387/790] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:09.847660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e87c5af2-67e6-4363-b541-dc3494641777 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:09.848291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e87c5af2-67e6-4363-b541-dc3494641777 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:09.856992 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e87c5af2-67e6-4363-b541-dc3494641777 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.857457 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e87c5af2-67e6-4363-b541-dc3494641777 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.858253 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e87c5af2-67e6-4363-b541-dc3494641777 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.858719 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e87c5af2-67e6-4363-b541-dc3494641777 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.895156 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2a2b9ea7-1714-4319-9f76-820040aafe01 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:09.896145 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2a2b9ea7-1714-4319-9f76-820040aafe01 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:09.903178 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a2b9ea7-1714-4319-9f76-820040aafe01 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.903876 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a2b9ea7-1714-4319-9f76-820040aafe01 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.904830 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a2b9ea7-1714-4319-9f76-820040aafe01 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.905416 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2a2b9ea7-1714-4319-9f76-820040aafe01 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.954897 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e87c5af2-67e6-4363-b541-dc3494641777 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:09.972684 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e87c5af2-67e6-4363-b541-dc3494641777 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1242 microversion: 2.1 time: 0.135769 May 17 18:18:09.974545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 404/791] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:09 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:10.000833 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2a2b9ea7-1714-4319-9f76-820040aafe01 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:10.010316 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2a2b9ea7-1714-4319-9f76-820040aafe01 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1245 microversion: 2.1 time: 0.119501 May 17 18:18:10.011111 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 388/792] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:09 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:10.697012 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-087f1bac-cce9-4e5d-b34c-2134dcb7ddb8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:10.697633 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-087f1bac-cce9-4e5d-b34c-2134dcb7ddb8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:10.703461 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-087f1bac-cce9-4e5d-b34c-2134dcb7ddb8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.703916 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-087f1bac-cce9-4e5d-b34c-2134dcb7ddb8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.704689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-087f1bac-cce9-4e5d-b34c-2134dcb7ddb8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.705304 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-087f1bac-cce9-4e5d-b34c-2134dcb7ddb8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.972916 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-087f1bac-cce9-4e5d-b34c-2134dcb7ddb8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:10.982100 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-087f1bac-cce9-4e5d-b34c-2134dcb7ddb8 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1690 microversion: 2.1 time: 0.288812 May 17 18:18:10.992498 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 405/793] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:10 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1690 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:10.992691 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-59c81ce4-aa1c-4b20-82e2-70e40bdd6213 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:10.992691 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-59c81ce4-aa1c-4b20-82e2-70e40bdd6213 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:10.998846 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59c81ce4-aa1c-4b20-82e2-70e40bdd6213 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.999578 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59c81ce4-aa1c-4b20-82e2-70e40bdd6213 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.000549 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59c81ce4-aa1c-4b20-82e2-70e40bdd6213 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.001180 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59c81ce4-aa1c-4b20-82e2-70e40bdd6213 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.027912 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a2e906a4-b3a4-4ee4-8718-bc88fa61d096 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:11.028988 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a2e906a4-b3a4-4ee4-8718-bc88fa61d096 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:11.036065 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a2e906a4-b3a4-4ee4-8718-bc88fa61d096 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.036976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a2e906a4-b3a4-4ee4-8718-bc88fa61d096 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.038022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a2e906a4-b3a4-4ee4-8718-bc88fa61d096 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.038849 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a2e906a4-b3a4-4ee4-8718-bc88fa61d096 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.106367 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-59c81ce4-aa1c-4b20-82e2-70e40bdd6213 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:11.115465 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-59c81ce4-aa1c-4b20-82e2-70e40bdd6213 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1298 microversion: 2.1 time: 0.128820 May 17 18:18:11.116049 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 389/794] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:10 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:11.174018 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a2e906a4-b3a4-4ee4-8718-bc88fa61d096 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:11.187181 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a2e906a4-b3a4-4ee4-8718-bc88fa61d096 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1293 microversion: 2.1 time: 0.163141 May 17 18:18:11.188445 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 406/795] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:11 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:11.575863 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c5905e76-542a-4d13-a1ee-f2ddbc5fd7b8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:11.576594 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c5905e76-542a-4d13-a1ee-f2ddbc5fd7b8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:11.585594 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5905e76-542a-4d13-a1ee-f2ddbc5fd7b8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.586336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5905e76-542a-4d13-a1ee-f2ddbc5fd7b8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.587552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5905e76-542a-4d13-a1ee-f2ddbc5fd7b8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.588825 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c5905e76-542a-4d13-a1ee-f2ddbc5fd7b8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.686500 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-c5905e76-542a-4d13-a1ee-f2ddbc5fd7b8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lazy-loading 'services' on Instance uuid 5792551b-b2ce-425d-9831-77b469c883c8 {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:18:11.770773 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c5905e76-542a-4d13-a1ee-f2ddbc5fd7b8 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments/6d064e4c-f786-4390-8ea5-2211d7e5d873" status: 202 len: 0 microversion: 2.1 time: 0.198539 May 17 18:18:11.771407 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 390/796] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:18:11 2022] DELETE /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments/6d064e4c-f786-4390-8ea5-2211d7e5d873 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:18:11.779948 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-93076ee5-f41f-4ed4-9175-4c01a0f9ca3d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:11.780965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-93076ee5-f41f-4ed4-9175-4c01a0f9ca3d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:11.794098 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93076ee5-f41f-4ed4-9175-4c01a0f9ca3d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.794679 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93076ee5-f41f-4ed4-9175-4c01a0f9ca3d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.798140 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93076ee5-f41f-4ed4-9175-4c01a0f9ca3d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.798669 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93076ee5-f41f-4ed4-9175-4c01a0f9ca3d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.832515 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-93076ee5-f41f-4ed4-9175-4c01a0f9ca3d tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055535 May 17 18:18:11.840000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 407/797] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:18:11 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:18:11.843598 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-e6cf5d5d-0f97-4b63-ae02-becd94ef1b04 req-c28c4fa0-9250-476b-9b6c-9a0dd1ef7710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5792551b-b2ce-425d-9831-77b469c883c8", "tag": "a29d526a-3dbb-4880-84ae-f0ec2191f0e2"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:11.858197 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-e6cf5d5d-0f97-4b63-ae02-becd94ef1b04 req-c28c4fa0-9250-476b-9b6c-9a0dd1ef7710 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.858982 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-e6cf5d5d-0f97-4b63-ae02-becd94ef1b04 req-c28c4fa0-9250-476b-9b6c-9a0dd1ef7710 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.873922 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-e6cf5d5d-0f97-4b63-ae02-becd94ef1b04 req-c28c4fa0-9250-476b-9b6c-9a0dd1ef7710 service nova] Creating event network-changed:a29d526a-3dbb-4880-84ae-f0ec2191f0e2 for instance 5792551b-b2ce-425d-9831-77b469c883c8 on hv-cinder-84130 May 17 18:18:11.879679 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-e6cf5d5d-0f97-4b63-ae02-becd94ef1b04 req-c28c4fa0-9250-476b-9b6c-9a0dd1ef7710 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044801 May 17 18:18:11.880786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 391/798] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:18:11.999865 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9ce90005-2f32-4e85-922c-e060b9d1ba83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:12.001456 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9ce90005-2f32-4e85-922c-e060b9d1ba83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:12.007542 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9ce90005-2f32-4e85-922c-e060b9d1ba83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.008023 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9ce90005-2f32-4e85-922c-e060b9d1ba83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.008804 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9ce90005-2f32-4e85-922c-e060b9d1ba83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.009239 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9ce90005-2f32-4e85-922c-e060b9d1ba83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.135755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bad5e2db-b3c7-4c9e-bf5e-25a66ecbddf3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:12.137347 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-bad5e2db-b3c7-4c9e-bf5e-25a66ecbddf3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:12.147081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bad5e2db-b3c7-4c9e-bf5e-25a66ecbddf3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.148397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bad5e2db-b3c7-4c9e-bf5e-25a66ecbddf3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.149877 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bad5e2db-b3c7-4c9e-bf5e-25a66ecbddf3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.151075 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bad5e2db-b3c7-4c9e-bf5e-25a66ecbddf3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.154093 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9ce90005-2f32-4e85-922c-e060b9d1ba83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:12.162879 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9ce90005-2f32-4e85-922c-e060b9d1ba83 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1690 microversion: 2.1 time: 0.166812 May 17 18:18:12.171104 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 408/799] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:11 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:12.208475 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0175ca49-b7c4-4a30-85bf-1f69f7b09675 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:12.210715 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0175ca49-b7c4-4a30-85bf-1f69f7b09675 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:12.219309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0175ca49-b7c4-4a30-85bf-1f69f7b09675 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.219958 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0175ca49-b7c4-4a30-85bf-1f69f7b09675 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.221351 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0175ca49-b7c4-4a30-85bf-1f69f7b09675 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.221953 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0175ca49-b7c4-4a30-85bf-1f69f7b09675 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.242986 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-bad5e2db-b3c7-4c9e-bf5e-25a66ecbddf3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:12.265752 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-bad5e2db-b3c7-4c9e-bf5e-25a66ecbddf3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1296 microversion: 2.1 time: 0.135253 May 17 18:18:12.270647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 392/800] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:12 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1296 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:12.363609 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0175ca49-b7c4-4a30-85bf-1f69f7b09675 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:12.374246 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0175ca49-b7c4-4a30-85bf-1f69f7b09675 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1299 microversion: 2.1 time: 0.171941 May 17 18:18:12.387065 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 409/801] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:12 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1299 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:12.852944 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-67df2673-fae8-4a24-90ee-8ddd1df7fe82 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:12.854279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-67df2673-fae8-4a24-90ee-8ddd1df7fe82 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:12.864426 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67df2673-fae8-4a24-90ee-8ddd1df7fe82 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.865874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67df2673-fae8-4a24-90ee-8ddd1df7fe82 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.866901 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67df2673-fae8-4a24-90ee-8ddd1df7fe82 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.867537 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67df2673-fae8-4a24-90ee-8ddd1df7fe82 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.902048 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-67df2673-fae8-4a24-90ee-8ddd1df7fe82 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054676 May 17 18:18:12.903489 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 393/802] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:18:12 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:18:12.913819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-01e88102-a65d-4a75-843a-4fc571c9e2bd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:12.914644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-01e88102-a65d-4a75-843a-4fc571c9e2bd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:12.924020 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-01e88102-a65d-4a75-843a-4fc571c9e2bd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.924760 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-01e88102-a65d-4a75-843a-4fc571c9e2bd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.926466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-01e88102-a65d-4a75-843a-4fc571c9e2bd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.927244 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-01e88102-a65d-4a75-843a-4fc571c9e2bd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.021217 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-01e88102-a65d-4a75-843a-4fc571c9e2bd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] HTTP exception thrown: Instance 5792551b-b2ce-425d-9831-77b469c883c8 is not attached to volume 6d064e4c-f786-4390-8ea5-2211d7e5d873 May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-01e88102-a65d-4a75-843a-4fc571c9e2bd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Request method failure captured: May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: DELETE /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments/6d064e4c-f786-4390-8ea5-2211d7e5d873 HTTP/1.1 May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-YtsOc9p6VnXMztcCjW7Thw5lWa-pBI02KgLMUzSwzSboTjSBWlL100puHwJ3yi_Bmgl4byPoEPEbNaEADmxfFetDGzBvSbA1JqwealH-vhqR-EUuB8u9Q8w9h2yx3G8_90Nh9S-eEwld74T6FvJFMSiinqiRci3iyMZX8SMa0QkPU May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: a0b25b97710c4115871b094e03709347 May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-TestMinimumBasicScenario-474768215 May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:18:13.028582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a0b25b97710c4115871b094e03709347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0b25b97710c4115871b094e03709347"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0b25b97710c4115871b094e03709347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a0b25b97710c4115871b094e03709347", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-TestMinimumBasicScenario-474768215 May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: a0b25b97710c4115871b094e03709347 May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-TestMinimumBasicScenario-474768215 May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-TestMinimumBasicScenario-474768215-project May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 759c9a68b8044d1a92b73f18c8f09d4d May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-TestMinimumBasicScenario-474768215-project May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:18:13.030073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 5792551b-b2ce-425d-9831-77b469c883c8 is not attached to volume 6d064e4c-f786-4390-8ea5-2211d7e5d873 May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'server_id': '5792551b-b2ce-425d-9831-77b469c883c8', 'id': '6d064e4c-f786-4390-8ea5-2211d7e5d873'} May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6d064e4c-f786-4390-8ea5-2211d7e5d873. May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:13.031057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5792551b-b2ce-425d-9831-77b469c883c8 is not attached to volume 6d064e4c-f786-4390-8ea5-2211d7e5d873 May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5792551b-b2ce-425d-9831-77b469c883c8 is not attached to volume 6d064e4c-f786-4390-8ea5-2211d7e5d873 May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:13.032556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-01e88102-a65d-4a75-843a-4fc571c9e2bd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Returning 404 to user: Instance 5792551b-b2ce-425d-9831-77b469c883c8 is not attached to volume 6d064e4c-f786-4390-8ea5-2211d7e5d873 {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:13.034191 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-01e88102-a65d-4a75-843a-4fc571c9e2bd tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments/6d064e4c-f786-4390-8ea5-2211d7e5d873" status: 404 len: 154 microversion: 2.1 time: 0.120934 May 17 18:18:13.034191 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 410/803] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:18:12 2022] DELETE /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8/os-volume_attachments/6d064e4c-f786-4390-8ea5-2211d7e5d873 => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:13.180396 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-475f70f6-5400-44de-8ed9-ec2b07d10f4b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:13.181217 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-475f70f6-5400-44de-8ed9-ec2b07d10f4b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:13.195514 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-475f70f6-5400-44de-8ed9-ec2b07d10f4b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.196956 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-475f70f6-5400-44de-8ed9-ec2b07d10f4b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.199613 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-475f70f6-5400-44de-8ed9-ec2b07d10f4b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.200806 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-475f70f6-5400-44de-8ed9-ec2b07d10f4b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.314526 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-a31d6730-0d5a-4611-8994-b6b5545b2929 req-bd858717-3030-4f52-b822-edb8d8031084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1966aa90-f5e3-4591-8105-69f6cc0fbdfb", "name": "network-vif-deleted", "tag": "c45336db-0e36-4d75-8c9b-f63dc16532f1"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:13.329054 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-a31d6730-0d5a-4611-8994-b6b5545b2929 req-bd858717-3030-4f52-b822-edb8d8031084 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.329505 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-a31d6730-0d5a-4611-8994-b6b5545b2929 req-bd858717-3030-4f52-b822-edb8d8031084 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.361830 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-a31d6730-0d5a-4611-8994-b6b5545b2929 req-bd858717-3030-4f52-b822-edb8d8031084 service nova] Creating event network-vif-deleted:c45336db-0e36-4d75-8c9b-f63dc16532f1 for instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb on hv-cinder-84130 May 17 18:18:13.365108 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-475f70f6-5400-44de-8ed9-ec2b07d10f4b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:13.378426 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-475f70f6-5400-44de-8ed9-ec2b07d10f4b tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 200 len: 1623 microversion: 2.1 time: 0.201743 May 17 18:18:13.380774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 394/804] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:13 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 1623 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:13.389369 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-dd0681af-0b78-47dd-9a27-89b7587fd373 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:13.390263 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-dd0681af-0b78-47dd-9a27-89b7587fd373 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:13.391928 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-a31d6730-0d5a-4611-8994-b6b5545b2929 req-bd858717-3030-4f52-b822-edb8d8031084 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204205 May 17 18:18:13.399336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dd0681af-0b78-47dd-9a27-89b7587fd373 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.400053 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dd0681af-0b78-47dd-9a27-89b7587fd373 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.400208 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 411/805] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:13.401386 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dd0681af-0b78-47dd-9a27-89b7587fd373 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.407064 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6955bb2c-6b45-44ed-83af-cea2350eda15 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:13.411723 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6955bb2c-6b45-44ed-83af-cea2350eda15 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:13.413640 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-dd0681af-0b78-47dd-9a27-89b7587fd373 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.425407 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6955bb2c-6b45-44ed-83af-cea2350eda15 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.428589 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6955bb2c-6b45-44ed-83af-cea2350eda15 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.429730 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6955bb2c-6b45-44ed-83af-cea2350eda15 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.430516 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6955bb2c-6b45-44ed-83af-cea2350eda15 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.688203 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-dd0681af-0b78-47dd-9a27-89b7587fd373 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:13.698243 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-dd0681af-0b78-47dd-9a27-89b7587fd373 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.315716 May 17 18:18:13.702354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 395/806] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:13 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:13.726898 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6955bb2c-6b45-44ed-83af-cea2350eda15 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:13.735647 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6955bb2c-6b45-44ed-83af-cea2350eda15 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.332711 May 17 18:18:13.746359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 412/807] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:13 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:14.181978 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fbb3e856-19ca-4479-a933-b4fd279731a7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.182649 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fbb3e856-19ca-4479-a933-b4fd279731a7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:14.188855 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fbb3e856-19ca-4479-a933-b4fd279731a7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.189397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fbb3e856-19ca-4479-a933-b4fd279731a7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.190250 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fbb3e856-19ca-4479-a933-b4fd279731a7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.190794 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fbb3e856-19ca-4479-a933-b4fd279731a7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.220047 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fbb3e856-19ca-4479-a933-b4fd279731a7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Going to try to terminate instance {{(pid=117020) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:18:14.299853 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fbb3e856-19ca-4479-a933-b4fd279731a7 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 204 len: 0 microversion: 2.1 time: 0.121669 May 17 18:18:14.301304 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 396/808] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:18:14 2022] DELETE /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 18:18:14.310100 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-98278b0a-31b2-4e81-b237-33de986dc23a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.310751 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-98278b0a-31b2-4e81-b237-33de986dc23a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:14.318700 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-98278b0a-31b2-4e81-b237-33de986dc23a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.319207 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-98278b0a-31b2-4e81-b237-33de986dc23a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.320279 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-98278b0a-31b2-4e81-b237-33de986dc23a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.320783 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-98278b0a-31b2-4e81-b237-33de986dc23a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.398035 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f21b4d1a-7dcd-4ec6-b691-a2531cb11615 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.398743 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f21b4d1a-7dcd-4ec6-b691-a2531cb11615 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 1966aa90-f5e3-4591-8105-69f6cc0fbdfb] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:14.408812 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f21b4d1a-7dcd-4ec6-b691-a2531cb11615 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.409460 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f21b4d1a-7dcd-4ec6-b691-a2531cb11615 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.410878 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f21b4d1a-7dcd-4ec6-b691-a2531cb11615 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.411781 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f21b4d1a-7dcd-4ec6-b691-a2531cb11615 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.429333 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-f21b4d1a-7dcd-4ec6-b691-a2531cb11615 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] HTTP exception thrown: Instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb could not be found. May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f21b4d1a-7dcd-4ec6-b691-a2531cb11615 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Request method failure captured: May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb HTTP/1.1 May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WzWKI_qp77YHLeymkbA2nMR_qjOtmmqk6FaK9Yh75xjb8QQi3BjnX6MQP8riZ5sjsky4n7JVdRB8b1lc7H08V0xUoslnGDT-ip1glIuAAu0KM-xhJdoQgc3lKpgHfXh5chSWnW0mA98TTJaSlVnRvKoUQkzDfbsJt1EL74HYlh9BI May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: e32e7b68f0464827afc5ed835cee1d15 May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:18:14.433065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e32e7b68f0464827afc5ed835cee1d15", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: e32e7b68f0464827afc5ed835cee1d15 May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-ServerRescueNegativeTestJSON-1083069676-project May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 62a9f27a865b468989f672a05dbab350 May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1083069676-project May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb could not be found. May 17 18:18:14.434370 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '1966aa90-f5e3-4591-8105-69f6cc0fbdfb'} May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb could not be found. May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:14.435999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb could not be found. May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb could not be found. May 17 18:18:14.437643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:14.441484 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f21b4d1a-7dcd-4ec6-b691-a2531cb11615 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Returning 404 to user: Instance 1966aa90-f5e3-4591-8105-69f6cc0fbdfb could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:14.441484 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f21b4d1a-7dcd-4ec6-b691-a2531cb11615 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb" status: 404 len: 111 microversion: 2.1 time: 0.041072 May 17 18:18:14.441484 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 397/809] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:14 2022] GET /compute/v2.1/servers/1966aa90-f5e3-4591-8105-69f6cc0fbdfb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:14.446224 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e03152ca-6793-4a21-bf22-cb468fe9e0c6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '.version_select at 0x7f74abcaaf70>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.472973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e03152ca-6793-4a21-bf22-cb468fe9e0c6 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035026411" status: 202 len: 0 microversion: 2.1 time: 0.031729 May 17 18:18:14.473951 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 398/810] 10.222.0.25 () {58 vars in 1220 bytes} [Tue May 17 18:18:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035026411 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:18:14.482851 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-98278b0a-31b2-4e81-b237-33de986dc23a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:14.493959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-98278b0a-31b2-4e81-b237-33de986dc23a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1554 microversion: 2.1 time: 0.188342 May 17 18:18:14.495647 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 413/811] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:14 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:14.729308 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-75fcb333-d781-437d-8b8f-947b04eed04a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.736876 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-75fcb333-d781-437d-8b8f-947b04eed04a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:14.753532 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-becd2cd2-dff9-4521-af81-73742d3a17cc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.755577 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-becd2cd2-dff9-4521-af81-73742d3a17cc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:14.780465 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-becd2cd2-dff9-4521-af81-73742d3a17cc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.783554 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75fcb333-d781-437d-8b8f-947b04eed04a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.784585 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-becd2cd2-dff9-4521-af81-73742d3a17cc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.785878 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75fcb333-d781-437d-8b8f-947b04eed04a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.787689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-becd2cd2-dff9-4521-af81-73742d3a17cc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.788782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75fcb333-d781-437d-8b8f-947b04eed04a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.789492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-becd2cd2-dff9-4521-af81-73742d3a17cc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.793205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-75fcb333-d781-437d-8b8f-947b04eed04a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.152804 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-becd2cd2-dff9-4521-af81-73742d3a17cc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:15.164704 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-becd2cd2-dff9-4521-af81-73742d3a17cc tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.415257 May 17 18:18:15.172196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 414/812] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:14 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:15.202465 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-75fcb333-d781-437d-8b8f-947b04eed04a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:15.213404 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-75fcb333-d781-437d-8b8f-947b04eed04a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.500217 May 17 18:18:15.213987 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 399/813] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:14 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:15.423857 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-e45874f7-3caa-4bfb-b8b5-1b02b94b1e27 req-72058299-8467-4614-9a2f-1f46429aa391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1d264e-2d3a-4a16-9a14-1c7d756c620c", "tag": "c0c0c04b-f7a7-40fc-80b8-5514db09a6c9"}, {"name": "network-changed", "server_uuid": "5f36d239-5a80-418e-9e5c-ace79af53f6e", "tag": "6f151f25-60f1-4b8c-87db-feea63856248"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:15.434631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-e45874f7-3caa-4bfb-b8b5-1b02b94b1e27 req-72058299-8467-4614-9a2f-1f46429aa391 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.435148 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-e45874f7-3caa-4bfb-b8b5-1b02b94b1e27 req-72058299-8467-4614-9a2f-1f46429aa391 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.448741 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-e45874f7-3caa-4bfb-b8b5-1b02b94b1e27 req-72058299-8467-4614-9a2f-1f46429aa391 service nova] Creating event network-changed:c0c0c04b-f7a7-40fc-80b8-5514db09a6c9 for instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c on hv-cinder-84130 May 17 18:18:15.449322 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-e45874f7-3caa-4bfb-b8b5-1b02b94b1e27 req-72058299-8467-4614-9a2f-1f46429aa391 service nova] Creating event network-changed:6f151f25-60f1-4b8c-87db-feea63856248 for instance 5f36d239-5a80-418e-9e5c-ace79af53f6e on hv-cinder-84130 May 17 18:18:15.455760 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-e45874f7-3caa-4bfb-b8b5-1b02b94b1e27 req-72058299-8467-4614-9a2f-1f46429aa391 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035455 May 17 18:18:15.456415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 415/814] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:18:15.513004 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-35548511-8ca5-4baa-86fa-19cf2dad47ca tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:15.513696 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-35548511-8ca5-4baa-86fa-19cf2dad47ca tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:15.521900 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35548511-8ca5-4baa-86fa-19cf2dad47ca tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.522360 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35548511-8ca5-4baa-86fa-19cf2dad47ca tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.523185 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35548511-8ca5-4baa-86fa-19cf2dad47ca tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.523633 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-35548511-8ca5-4baa-86fa-19cf2dad47ca tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.656845 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-35548511-8ca5-4baa-86fa-19cf2dad47ca tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:15.665449 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-35548511-8ca5-4baa-86fa-19cf2dad47ca tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1554 microversion: 2.1 time: 0.156531 May 17 18:18:15.665952 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 400/815] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:15 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:16.182466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-06507210-e10a-4c8e-86c3-19f5690171ac tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:16.183227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-06507210-e10a-4c8e-86c3-19f5690171ac tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:16.189316 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-06507210-e10a-4c8e-86c3-19f5690171ac tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.189771 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-06507210-e10a-4c8e-86c3-19f5690171ac tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.190549 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-06507210-e10a-4c8e-86c3-19f5690171ac tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.191010 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-06507210-e10a-4c8e-86c3-19f5690171ac tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.231157 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-39aae692-b085-4f29-b360-c1b085fb57dc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:16.234907 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-39aae692-b085-4f29-b360-c1b085fb57dc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:16.242883 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39aae692-b085-4f29-b360-c1b085fb57dc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.243480 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39aae692-b085-4f29-b360-c1b085fb57dc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.244435 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39aae692-b085-4f29-b360-c1b085fb57dc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.245003 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39aae692-b085-4f29-b360-c1b085fb57dc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.380990 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-06507210-e10a-4c8e-86c3-19f5690171ac tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:16.388730 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-06507210-e10a-4c8e-86c3-19f5690171ac tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.210546 May 17 18:18:16.389395 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 416/816] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:16 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:16.407987 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-39aae692-b085-4f29-b360-c1b085fb57dc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:16.416039 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-39aae692-b085-4f29-b360-c1b085fb57dc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.189131 May 17 18:18:16.416614 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 401/817] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:16 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:16.682063 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8877556c-b8e0-48ca-b3bd-fb9a07d4928b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:16.682706 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8877556c-b8e0-48ca-b3bd-fb9a07d4928b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:16.688924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8877556c-b8e0-48ca-b3bd-fb9a07d4928b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.689379 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8877556c-b8e0-48ca-b3bd-fb9a07d4928b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.690214 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8877556c-b8e0-48ca-b3bd-fb9a07d4928b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.690758 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8877556c-b8e0-48ca-b3bd-fb9a07d4928b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.827349 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8877556c-b8e0-48ca-b3bd-fb9a07d4928b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:16.835737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8877556c-b8e0-48ca-b3bd-fb9a07d4928b tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1554 microversion: 2.1 time: 0.157532 May 17 18:18:16.836483 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 417/818] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:16 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:17.406648 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-59e6200e-9cb3-4870-aa5d-24711cf0426c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:17.407246 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-59e6200e-9cb3-4870-aa5d-24711cf0426c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:17.414280 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59e6200e-9cb3-4870-aa5d-24711cf0426c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.414772 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59e6200e-9cb3-4870-aa5d-24711cf0426c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.415580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59e6200e-9cb3-4870-aa5d-24711cf0426c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.416020 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-59e6200e-9cb3-4870-aa5d-24711cf0426c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.433121 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-cd0c07b0-4485-4e35-9861-50339966fd3f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:17.434041 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-cd0c07b0-4485-4e35-9861-50339966fd3f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:17.440432 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cd0c07b0-4485-4e35-9861-50339966fd3f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.440952 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cd0c07b0-4485-4e35-9861-50339966fd3f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.441855 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cd0c07b0-4485-4e35-9861-50339966fd3f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.442298 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cd0c07b0-4485-4e35-9861-50339966fd3f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.617470 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-59e6200e-9cb3-4870-aa5d-24711cf0426c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:17.624776 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-59e6200e-9cb3-4870-aa5d-24711cf0426c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.222080 May 17 18:18:17.625343 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 402/819] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:17 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:17.629629 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-cd0c07b0-4485-4e35-9861-50339966fd3f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:17.630315 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-3c424dfc-6c36-49ce-93b3-41cdb969e24d req-6c77b949-cd56-4a7e-8b69-a0d376879378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5792551b-b2ce-425d-9831-77b469c883c8", "name": "network-vif-deleted", "tag": "a29d526a-3dbb-4880-84ae-f0ec2191f0e2"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:17.637273 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-cd0c07b0-4485-4e35-9861-50339966fd3f tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.208230 May 17 18:18:17.637946 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 418/820] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:17 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:17.638119 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-3c424dfc-6c36-49ce-93b3-41cdb969e24d req-6c77b949-cd56-4a7e-8b69-a0d376879378 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.638563 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-3c424dfc-6c36-49ce-93b3-41cdb969e24d req-6c77b949-cd56-4a7e-8b69-a0d376879378 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.649862 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-3c424dfc-6c36-49ce-93b3-41cdb969e24d req-6c77b949-cd56-4a7e-8b69-a0d376879378 service nova] Creating event network-vif-deleted:a29d526a-3dbb-4880-84ae-f0ec2191f0e2 for instance 5792551b-b2ce-425d-9831-77b469c883c8 on hv-cinder-84130 May 17 18:18:17.654720 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-3c424dfc-6c36-49ce-93b3-41cdb969e24d req-6c77b949-cd56-4a7e-8b69-a0d376879378 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028236 May 17 18:18:17.655282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 403/821] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:17.686290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7566c82a-2106-48a5-8063-563ab538ea07 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:17.686829 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7566c82a-2106-48a5-8063-563ab538ea07 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:17.694073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7566c82a-2106-48a5-8063-563ab538ea07 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.694483 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7566c82a-2106-48a5-8063-563ab538ea07 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.695296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7566c82a-2106-48a5-8063-563ab538ea07 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.695746 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7566c82a-2106-48a5-8063-563ab538ea07 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.720001 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7566c82a-2106-48a5-8063-563ab538ea07 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:18:17.792739 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7566c82a-2106-48a5-8063-563ab538ea07 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "DELETE /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 204 len: 0 microversion: 2.1 time: 0.109988 May 17 18:18:17.793322 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 419/822] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:18:17 2022] DELETE /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:18:17.802659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fdbde4b6-6083-4b60-8b92-7770f248d3da tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:17.803365 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fdbde4b6-6083-4b60-8b92-7770f248d3da tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:17.809393 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fdbde4b6-6083-4b60-8b92-7770f248d3da tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.809847 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fdbde4b6-6083-4b60-8b92-7770f248d3da tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.810671 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fdbde4b6-6083-4b60-8b92-7770f248d3da tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.811268 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fdbde4b6-6083-4b60-8b92-7770f248d3da tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.854945 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6af001ca-7f30-47e6-9d88-6fface6c77ff tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:17.856021 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6af001ca-7f30-47e6-9d88-6fface6c77ff tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:17.862675 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6af001ca-7f30-47e6-9d88-6fface6c77ff tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.863960 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6af001ca-7f30-47e6-9d88-6fface6c77ff tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.864816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6af001ca-7f30-47e6-9d88-6fface6c77ff tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.865323 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6af001ca-7f30-47e6-9d88-6fface6c77ff tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.932635 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6af001ca-7f30-47e6-9d88-6fface6c77ff tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:17.939965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6af001ca-7f30-47e6-9d88-6fface6c77ff tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1344 microversion: 2.1 time: 0.089302 May 17 18:18:17.940527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 420/823] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:17 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:17.970521 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-fdbde4b6-6083-4b60-8b92-7770f248d3da tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:17.978089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fdbde4b6-6083-4b60-8b92-7770f248d3da tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1508 microversion: 2.1 time: 0.180457 May 17 18:18:17.978670 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 404/824] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:17 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:18.643498 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-055069ce-b485-4cb4-86db-7abffc8e7938 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:18.644801 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-055069ce-b485-4cb4-86db-7abffc8e7938 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:18.650945 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-055069ce-b485-4cb4-86db-7abffc8e7938 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.651413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-055069ce-b485-4cb4-86db-7abffc8e7938 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.652241 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-055069ce-b485-4cb4-86db-7abffc8e7938 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.652683 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-055069ce-b485-4cb4-86db-7abffc8e7938 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.654799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a1bf2f4f-5dd0-4669-8cb8-06177cf77b46 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:18.655419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a1bf2f4f-5dd0-4669-8cb8-06177cf77b46 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:18.662390 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a1bf2f4f-5dd0-4669-8cb8-06177cf77b46 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.662882 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a1bf2f4f-5dd0-4669-8cb8-06177cf77b46 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.663653 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a1bf2f4f-5dd0-4669-8cb8-06177cf77b46 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.664090 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a1bf2f4f-5dd0-4669-8cb8-06177cf77b46 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.839788 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-055069ce-b485-4cb4-86db-7abffc8e7938 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:18.842800 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a1bf2f4f-5dd0-4669-8cb8-06177cf77b46 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:18.846989 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-055069ce-b485-4cb4-86db-7abffc8e7938 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.207533 May 17 18:18:18.848273 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 421/825] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:18 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:18.850935 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a1bf2f4f-5dd0-4669-8cb8-06177cf77b46 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.199917 May 17 18:18:18.851602 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 405/826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:18 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:18.958764 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-cc078b43-4abb-44a5-8353-55c3fa2e128f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:18.959378 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-cc078b43-4abb-44a5-8353-55c3fa2e128f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:18.965371 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cc078b43-4abb-44a5-8353-55c3fa2e128f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.965809 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cc078b43-4abb-44a5-8353-55c3fa2e128f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.966590 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cc078b43-4abb-44a5-8353-55c3fa2e128f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.967033 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cc078b43-4abb-44a5-8353-55c3fa2e128f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.994913 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-31bcca33-338f-4d9f-a563-08c65fecbcdf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:18.995526 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-31bcca33-338f-4d9f-a563-08c65fecbcdf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:19.001493 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31bcca33-338f-4d9f-a563-08c65fecbcdf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.001947 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31bcca33-338f-4d9f-a563-08c65fecbcdf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:19.002745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31bcca33-338f-4d9f-a563-08c65fecbcdf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.003186 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-31bcca33-338f-4d9f-a563-08c65fecbcdf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:19.038502 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-cc078b43-4abb-44a5-8353-55c3fa2e128f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:19.046105 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-cc078b43-4abb-44a5-8353-55c3fa2e128f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1344 microversion: 2.1 time: 0.092075 May 17 18:18:19.046830 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 422/827] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:18 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:19.133318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-31bcca33-338f-4d9f-a563-08c65fecbcdf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:19.140663 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-31bcca33-338f-4d9f-a563-08c65fecbcdf tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1508 microversion: 2.1 time: 0.149562 May 17 18:18:19.141228 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 406/828] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:18 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:19.864957 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3ffe4957-6b1c-4a56-a16a-735137b41add tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:19.865599 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3ffe4957-6b1c-4a56-a16a-735137b41add tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:19.866893 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-cd9c7286-05d0-42e3-bfe5-c790bea2c919 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:19.867512 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-cd9c7286-05d0-42e3-bfe5-c790bea2c919 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:19.871873 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ffe4957-6b1c-4a56-a16a-735137b41add tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.872331 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ffe4957-6b1c-4a56-a16a-735137b41add tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:19.873103 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ffe4957-6b1c-4a56-a16a-735137b41add tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.873580 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3ffe4957-6b1c-4a56-a16a-735137b41add tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:19.873728 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cd9c7286-05d0-42e3-bfe5-c790bea2c919 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.874159 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cd9c7286-05d0-42e3-bfe5-c790bea2c919 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:19.874966 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cd9c7286-05d0-42e3-bfe5-c790bea2c919 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.875418 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cd9c7286-05d0-42e3-bfe5-c790bea2c919 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.080318 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3ffe4957-6b1c-4a56-a16a-735137b41add tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.083966 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-cd9c7286-05d0-42e3-bfe5-c790bea2c919 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.088887 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3ffe4957-6b1c-4a56-a16a-735137b41add tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.227703 May 17 18:18:20.089531 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 423/829] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:19 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:20.096251 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-cd9c7286-05d0-42e3-bfe5-c790bea2c919 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.228811 May 17 18:18:20.096251 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 407/830] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:19 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:20.096434 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:20.096434 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:20.101252 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.101705 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.102468 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.102939 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.133116 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.133484 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.133926 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lazy-loading 'fault' on Instance uuid 5792551b-b2ce-425d-9831-77b469c883c8 {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:18:20.161118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-82b345ce-ccfc-4120-bcb1-3c93692ef27a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:20.163434 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-82b345ce-ccfc-4120-bcb1-3c93692ef27a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:20.167856 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-82b345ce-ccfc-4120-bcb1-3c93692ef27a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.168317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-82b345ce-ccfc-4120-bcb1-3c93692ef27a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.169149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-82b345ce-ccfc-4120-bcb1-3c93692ef27a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.169658 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-82b345ce-ccfc-4120-bcb1-3c93692ef27a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.175785 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.183408 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e09dda06-cc9e-480d-b269-36e37d77614a tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1349 microversion: 2.1 time: 0.092954 May 17 18:18:20.184182 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 424/831] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:20 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:20.297966 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-82b345ce-ccfc-4120-bcb1-3c93692ef27a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.306963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-82b345ce-ccfc-4120-bcb1-3c93692ef27a tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1508 microversion: 2.1 time: 0.153555 May 17 18:18:20.317071 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 408/832] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:20 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:21.106468 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-21434961-774c-4d02-970d-120715482a4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:21.111688 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a6e07c79-e721-4d2b-a0f7-7fc6609d8c21 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:21.112308 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a6e07c79-e721-4d2b-a0f7-7fc6609d8c21 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:21.115589 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-21434961-774c-4d02-970d-120715482a4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:21.118870 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6e07c79-e721-4d2b-a0f7-7fc6609d8c21 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.119332 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6e07c79-e721-4d2b-a0f7-7fc6609d8c21 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.120117 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6e07c79-e721-4d2b-a0f7-7fc6609d8c21 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.120561 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6e07c79-e721-4d2b-a0f7-7fc6609d8c21 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.121904 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-21434961-774c-4d02-970d-120715482a4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.122360 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-21434961-774c-4d02-970d-120715482a4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.123164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-21434961-774c-4d02-970d-120715482a4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.123598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-21434961-774c-4d02-970d-120715482a4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.316617 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a6e07c79-e721-4d2b-a0f7-7fc6609d8c21 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:21.333735 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-21434961-774c-4d02-970d-120715482a4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:21.334762 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a6e07c79-e721-4d2b-a0f7-7fc6609d8c21 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.226891 May 17 18:18:21.335232 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 409/833] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:21 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:21.343680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-21434961-774c-4d02-970d-120715482a4d tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.241062 May 17 18:18:21.353527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 425/834] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:21 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:21.353527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-df6b8ea6-59d4-43e1-b8c9-a8c700809c41 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:21.353527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-df6b8ea6-59d4-43e1-b8c9-a8c700809c41 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:21.354429 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:21.355656 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:21.359971 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df6b8ea6-59d4-43e1-b8c9-a8c700809c41 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.360685 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df6b8ea6-59d4-43e1-b8c9-a8c700809c41 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.361801 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df6b8ea6-59d4-43e1-b8c9-a8c700809c41 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.362464 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df6b8ea6-59d4-43e1-b8c9-a8c700809c41 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.365959 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.366406 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.367208 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.367660 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.408647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.409110 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.410335 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lazy-loading 'fault' on Instance uuid 5792551b-b2ce-425d-9831-77b469c883c8 {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:18:21.483343 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759c9a68b8044d1a92b73f18c8f09d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b25b97710c4115871b094e03709347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:21.491090 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-18a45d73-2117-46b1-863a-d090a4bac056 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 200 len: 1349 microversion: 2.1 time: 0.154713 May 17 18:18:21.493058 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 410/835] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:21 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 1349 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:21.550011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-df6b8ea6-59d4-43e1-b8c9-a8c700809c41 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:21.560087 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-df6b8ea6-59d4-43e1-b8c9-a8c700809c41 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 200 len: 1508 microversion: 2.1 time: 0.211739 May 17 18:18:21.561091 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 426/836] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:21 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:21.935038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-eab3d704-3eee-45ac-b14c-552b0ca329a7 req-55dbe309-cb18-4c6d-a23a-5766bb6b4331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866f96bb-2e7f-45e6-be98-859df625039a", "name": "network-vif-deleted", "tag": "e8f715c1-6f11-4eda-a7e2-1cb6b1f3cbcf"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:21.944421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-eab3d704-3eee-45ac-b14c-552b0ca329a7 req-55dbe309-cb18-4c6d-a23a-5766bb6b4331 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.944872 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-eab3d704-3eee-45ac-b14c-552b0ca329a7 req-55dbe309-cb18-4c6d-a23a-5766bb6b4331 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.957704 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-eab3d704-3eee-45ac-b14c-552b0ca329a7 req-55dbe309-cb18-4c6d-a23a-5766bb6b4331 service nova] Creating event network-vif-deleted:e8f715c1-6f11-4eda-a7e2-1cb6b1f3cbcf for instance 866f96bb-2e7f-45e6-be98-859df625039a on hv-cinder-84130 May 17 18:18:21.963871 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-eab3d704-3eee-45ac-b14c-552b0ca329a7 req-55dbe309-cb18-4c6d-a23a-5766bb6b4331 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032564 May 17 18:18:21.964641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 411/837] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:22.352936 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-80c79d81-1ff0-4564-8b58-7142e1bc7ed7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:22.353569 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-80c79d81-1ff0-4564-8b58-7142e1bc7ed7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:22.361586 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-331e206f-423b-4cba-b327-15b038a119a3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:22.362102 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-80c79d81-1ff0-4564-8b58-7142e1bc7ed7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.362342 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-80c79d81-1ff0-4564-8b58-7142e1bc7ed7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.363244 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-331e206f-423b-4cba-b327-15b038a119a3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:22.363456 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-80c79d81-1ff0-4564-8b58-7142e1bc7ed7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.363907 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-80c79d81-1ff0-4564-8b58-7142e1bc7ed7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.369978 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-331e206f-423b-4cba-b327-15b038a119a3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.370425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-331e206f-423b-4cba-b327-15b038a119a3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.371397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-331e206f-423b-4cba-b327-15b038a119a3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.371996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-331e206f-423b-4cba-b327-15b038a119a3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.564544 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-80c79d81-1ff0-4564-8b58-7142e1bc7ed7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:22.568460 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-331e206f-423b-4cba-b327-15b038a119a3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:22.573236 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-80c79d81-1ff0-4564-8b58-7142e1bc7ed7 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.225004 May 17 18:18:22.575961 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-331e206f-423b-4cba-b327-15b038a119a3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.218585 May 17 18:18:22.576217 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 427/838] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:22 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:22.576513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 412/839] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:22 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:22.582262 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4ca0dd1b-307c-4bcd-aaca-406709eedc54 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:22.582915 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4ca0dd1b-307c-4bcd-aaca-406709eedc54 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] [instance: 5792551b-b2ce-425d-9831-77b469c883c8] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:22.587988 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c9740a92-b7da-456a-a8af-903dc21006c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:22.588685 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c9740a92-b7da-456a-a8af-903dc21006c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 866f96bb-2e7f-45e6-be98-859df625039a] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:22.588964 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4ca0dd1b-307c-4bcd-aaca-406709eedc54 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.589427 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4ca0dd1b-307c-4bcd-aaca-406709eedc54 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.590209 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4ca0dd1b-307c-4bcd-aaca-406709eedc54 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.590678 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4ca0dd1b-307c-4bcd-aaca-406709eedc54 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.594312 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c9740a92-b7da-456a-a8af-903dc21006c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.594807 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c9740a92-b7da-456a-a8af-903dc21006c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.595575 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c9740a92-b7da-456a-a8af-903dc21006c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.596013 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c9740a92-b7da-456a-a8af-903dc21006c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.604061 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-4ca0dd1b-307c-4bcd-aaca-406709eedc54 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] HTTP exception thrown: Instance 5792551b-b2ce-425d-9831-77b469c883c8 could not be found. May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4ca0dd1b-307c-4bcd-aaca-406709eedc54 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Request method failure captured: May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 HTTP/1.1 May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-YtsOc9p6VnXMztcCjW7Thw5lWa-pBI02KgLMUzSwzSboTjSBWlL100puHwJ3yi_Bmgl4byPoEPEbNaEADmxfFetDGzBvSbA1JqwealH-vhqR-EUuB8u9Q8w9h2yx3G8_90Nh9S-eEwld74T6FvJFMSiinqiRci3iyMZX8SMa0QkPU May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: a0b25b97710c4115871b094e03709347 May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-TestMinimumBasicScenario-474768215 May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:18:22.605703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a0b25b97710c4115871b094e03709347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0b25b97710c4115871b094e03709347"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0b25b97710c4115871b094e03709347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a0b25b97710c4115871b094e03709347", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-TestMinimumBasicScenario-474768215 May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: a0b25b97710c4115871b094e03709347 May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-TestMinimumBasicScenario-474768215 May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-TestMinimumBasicScenario-474768215-project May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 759c9a68b8044d1a92b73f18c8f09d4d May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-TestMinimumBasicScenario-474768215-project May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 5792551b-b2ce-425d-9831-77b469c883c8 could not be found. May 17 18:18:22.607043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '5792551b-b2ce-425d-9831-77b469c883c8'} May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5792551b-b2ce-425d-9831-77b469c883c8 could not be found. May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:22.607765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5792551b-b2ce-425d-9831-77b469c883c8 could not be found. May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5792551b-b2ce-425d-9831-77b469c883c8 could not be found. May 17 18:18:22.609350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:22.610381 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4ca0dd1b-307c-4bcd-aaca-406709eedc54 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Returning 404 to user: Instance 5792551b-b2ce-425d-9831-77b469c883c8 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:22.610381 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4ca0dd1b-307c-4bcd-aaca-406709eedc54 tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8" status: 404 len: 111 microversion: 2.1 time: 0.029801 May 17 18:18:22.610381 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 428/840] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:22 2022] GET /compute/v2.1/servers/5792551b-b2ce-425d-9831-77b469c883c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:22.611214 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-c9740a92-b7da-456a-a8af-903dc21006c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] HTTP exception thrown: Instance 866f96bb-2e7f-45e6-be98-859df625039a could not be found. May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c9740a92-b7da-456a-a8af-903dc21006c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Request method failure captured: May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a HTTP/1.1 May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WzWKI_qp77YHLeymkbA2nMR_qjOtmmqk6FaK9Yh75xjb8QQi3BjnX6MQP8riZ5sjsky4n7JVdRB8b1lc7H08V0xUoslnGDT-ip1glIuAAu0KM-xhJdoQgc3lKpgHfXh5chSWnW0mA98TTJaSlVnRvKoUQkzDfbsJt1EL74HYlh9BI May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: e32e7b68f0464827afc5ed835cee1d15 May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:18:22.612181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e32e7b68f0464827afc5ed835cee1d15", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: e32e7b68f0464827afc5ed835cee1d15 May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-ServerRescueNegativeTestJSON-1083069676-project May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 62a9f27a865b468989f672a05dbab350 May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1083069676-project May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 866f96bb-2e7f-45e6-be98-859df625039a could not be found. May 17 18:18:22.614354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '866f96bb-2e7f-45e6-be98-859df625039a'} May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866f96bb-2e7f-45e6-be98-859df625039a could not be found. May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:22.615281 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866f96bb-2e7f-45e6-be98-859df625039a could not be found. May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866f96bb-2e7f-45e6-be98-859df625039a could not be found. May 17 18:18:22.616867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:22.618395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c9740a92-b7da-456a-a8af-903dc21006c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Returning 404 to user: Instance 866f96bb-2e7f-45e6-be98-859df625039a could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:22.618395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c9740a92-b7da-456a-a8af-903dc21006c5 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a" status: 404 len: 111 microversion: 2.1 time: 0.036719 May 17 18:18:22.618395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 413/841] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:22 2022] GET /compute/v2.1/servers/866f96bb-2e7f-45e6-be98-859df625039a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:22.618673 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5d0e4c63-907d-43ef-bd1a-458cbd40086f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] Calling method '.version_select at 0x7f74bce284c0>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:22.622338 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-57ef8cd9-c6d9-4803-9755-39f6007e3452 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:22.622867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-57ef8cd9-c6d9-4803-9755-39f6007e3452 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:22.629544 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57ef8cd9-c6d9-4803-9755-39f6007e3452 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.630176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57ef8cd9-c6d9-4803-9755-39f6007e3452 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.631021 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57ef8cd9-c6d9-4803-9755-39f6007e3452 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.631521 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57ef8cd9-c6d9-4803-9755-39f6007e3452 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.634062 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5d0e4c63-907d-43ef-bd1a-458cbd40086f tempest-TestMinimumBasicScenario-474768215 tempest-TestMinimumBasicScenario-474768215-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1511506757" status: 202 len: 0 microversion: 2.1 time: 0.022033 May 17 18:18:22.634851 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 429/842] 10.222.0.25 () {58 vars in 1271 bytes} [Tue May 17 18:18:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1511506757 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:18:22.657221 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-57ef8cd9-c6d9-4803-9755-39f6007e3452 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Going to try to terminate instance {{(pid=117020) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:18:22.737052 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-57ef8cd9-c6d9-4803-9755-39f6007e3452 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "DELETE /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 204 len: 0 microversion: 2.1 time: 0.117646 May 17 18:18:22.740739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 414/843] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:18:22 2022] DELETE /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 18:18:22.745928 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4d531660-cf11-4426-a2ec-c3b5154f8231 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:22.746542 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4d531660-cf11-4426-a2ec-c3b5154f8231 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:22.752715 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4d531660-cf11-4426-a2ec-c3b5154f8231 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.753763 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4d531660-cf11-4426-a2ec-c3b5154f8231 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.754889 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4d531660-cf11-4426-a2ec-c3b5154f8231 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.755336 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4d531660-cf11-4426-a2ec-c3b5154f8231 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.884310 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4d531660-cf11-4426-a2ec-c3b5154f8231 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:22.891580 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4d531660-cf11-4426-a2ec-c3b5154f8231 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.149545 May 17 18:18:22.892146 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 430/844] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:22 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:23.393628 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-f114f3d5-294a-4cc6-8ecd-0045c757a0a6 req-4c860ea6-d920-4ee6-8bf0-2574142f8129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f36d239-5a80-418e-9e5c-ace79af53f6e", "name": "network-vif-plugged", "status": "completed", "tag": "6f151f25-60f1-4b8c-87db-feea63856248"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:23.402378 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-f114f3d5-294a-4cc6-8ecd-0045c757a0a6 req-4c860ea6-d920-4ee6-8bf0-2574142f8129 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.402937 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-f114f3d5-294a-4cc6-8ecd-0045c757a0a6 req-4c860ea6-d920-4ee6-8bf0-2574142f8129 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:23.414911 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-f114f3d5-294a-4cc6-8ecd-0045c757a0a6 req-4c860ea6-d920-4ee6-8bf0-2574142f8129 service nova] Creating event network-vif-plugged:6f151f25-60f1-4b8c-87db-feea63856248 for instance 5f36d239-5a80-418e-9e5c-ace79af53f6e on hv-cinder-84130 May 17 18:18:23.420584 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-f114f3d5-294a-4cc6-8ecd-0045c757a0a6 req-4c860ea6-d920-4ee6-8bf0-2574142f8129 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095975 May 17 18:18:23.421685 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 415/845] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:23.589863 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-50ca06d7-cc1c-4e14-806e-738f370e3726 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:23.590529 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-50ca06d7-cc1c-4e14-806e-738f370e3726 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:23.593303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-43a4b428-2614-426e-b502-9217a54b6e5a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:23.594022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-43a4b428-2614-426e-b502-9217a54b6e5a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:23.597896 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-50ca06d7-cc1c-4e14-806e-738f370e3726 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.598626 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-50ca06d7-cc1c-4e14-806e-738f370e3726 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:23.600897 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-50ca06d7-cc1c-4e14-806e-738f370e3726 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.601294 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-43a4b428-2614-426e-b502-9217a54b6e5a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.601431 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-50ca06d7-cc1c-4e14-806e-738f370e3726 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:23.601758 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-43a4b428-2614-426e-b502-9217a54b6e5a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:23.605318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-43a4b428-2614-426e-b502-9217a54b6e5a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.605838 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-43a4b428-2614-426e-b502-9217a54b6e5a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:24.064940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-50ca06d7-cc1c-4e14-806e-738f370e3726 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:24.073097 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-50ca06d7-cc1c-4e14-806e-738f370e3726 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.487456 May 17 18:18:24.074107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 431/846] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:23 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:24.075237 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-43a4b428-2614-426e-b502-9217a54b6e5a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:24.079340 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c5354344-e66f-452e-9a43-1841744cfcaa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:24.079970 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c5354344-e66f-452e-9a43-1841744cfcaa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:24.085055 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-43a4b428-2614-426e-b502-9217a54b6e5a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.496081 May 17 18:18:24.085776 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 416/847] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:23 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:24.091004 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c5354344-e66f-452e-9a43-1841744cfcaa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:24.091481 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c5354344-e66f-452e-9a43-1841744cfcaa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:24.092268 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c5354344-e66f-452e-9a43-1841744cfcaa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:24.092718 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c5354344-e66f-452e-9a43-1841744cfcaa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:24.355409 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c5354344-e66f-452e-9a43-1841744cfcaa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:24.362531 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c5354344-e66f-452e-9a43-1841744cfcaa tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.287582 May 17 18:18:24.363276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 432/848] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:24 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:25.097944 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-220101df-22ee-44ad-af73-a9c6b114f3da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:25.099645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-220101df-22ee-44ad-af73-a9c6b114f3da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:25.107946 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-220101df-22ee-44ad-af73-a9c6b114f3da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.108532 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-220101df-22ee-44ad-af73-a9c6b114f3da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.109419 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-220101df-22ee-44ad-af73-a9c6b114f3da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.109976 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-220101df-22ee-44ad-af73-a9c6b114f3da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.164517 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c60a43f9-e7ac-41b2-a64b-d8185815d55e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:25.165714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c60a43f9-e7ac-41b2-a64b-d8185815d55e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:25.180483 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c60a43f9-e7ac-41b2-a64b-d8185815d55e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.181878 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c60a43f9-e7ac-41b2-a64b-d8185815d55e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.183088 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c60a43f9-e7ac-41b2-a64b-d8185815d55e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.183751 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c60a43f9-e7ac-41b2-a64b-d8185815d55e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.237427 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c60a43f9-e7ac-41b2-a64b-d8185815d55e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/ips" status: 200 len: 152 microversion: 2.20 time: 0.145183 May 17 18:18:25.242713 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 433/849] 10.222.0.25 () {60 vars in 1288 bytes} [Tue May 17 18:18:25 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/ips => generated 152 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:18:25.247881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c3bd0cb0-6ac8-4d9c-bb6c-de9b96c9e69f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:25.252656 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c3bd0cb0-6ac8-4d9c-bb6c-de9b96c9e69f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:25.274041 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c3bd0cb0-6ac8-4d9c-bb6c-de9b96c9e69f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.274834 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c3bd0cb0-6ac8-4d9c-bb6c-de9b96c9e69f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.275799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c3bd0cb0-6ac8-4d9c-bb6c-de9b96c9e69f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.276517 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c3bd0cb0-6ac8-4d9c-bb6c-de9b96c9e69f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.295757 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-220101df-22ee-44ad-af73-a9c6b114f3da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:25.308924 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-220101df-22ee-44ad-af73-a9c6b114f3da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.221678 May 17 18:18:25.312165 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 417/850] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:25 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:25.379404 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-beac5cca-70b3-4efe-b47b-e927a91725e7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:25.380387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-beac5cca-70b3-4efe-b47b-e927a91725e7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:25.388641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-beac5cca-70b3-4efe-b47b-e927a91725e7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.389404 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-beac5cca-70b3-4efe-b47b-e927a91725e7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.392317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-beac5cca-70b3-4efe-b47b-e927a91725e7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.392994 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-beac5cca-70b3-4efe-b47b-e927a91725e7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.523027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c3bd0cb0-6ac8-4d9c-bb6c-de9b96c9e69f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:25.537937 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c3bd0cb0-6ac8-4d9c-bb6c-de9b96c9e69f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.293773 May 17 18:18:25.545361 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 434/851] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:25 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:25.551407 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-a579f165-bffd-4115-9c2b-95c15d2b2b70 req-5910ed6a-7cbd-4e5e-8fa4-6991c497ef77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1d264e-2d3a-4a16-9a14-1c7d756c620c", "name": "network-vif-plugged", "status": "completed", "tag": "c0c0c04b-f7a7-40fc-80b8-5514db09a6c9"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:25.601191 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-a579f165-bffd-4115-9c2b-95c15d2b2b70 req-5910ed6a-7cbd-4e5e-8fa4-6991c497ef77 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.601643 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-a579f165-bffd-4115-9c2b-95c15d2b2b70 req-5910ed6a-7cbd-4e5e-8fa4-6991c497ef77 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.648066 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-a579f165-bffd-4115-9c2b-95c15d2b2b70 req-5910ed6a-7cbd-4e5e-8fa4-6991c497ef77 service nova] Creating event network-vif-plugged:c0c0c04b-f7a7-40fc-80b8-5514db09a6c9 for instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c on hv-cinder-84130 May 17 18:18:25.661074 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-a579f165-bffd-4115-9c2b-95c15d2b2b70 req-5910ed6a-7cbd-4e5e-8fa4-6991c497ef77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111062 May 17 18:18:25.663671 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 435/852] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:25.697198 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-beac5cca-70b3-4efe-b47b-e927a91725e7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:25.708599 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-beac5cca-70b3-4efe-b47b-e927a91725e7 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1522 microversion: 2.1 time: 0.333575 May 17 18:18:25.710172 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 418/853] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:25 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:26.336523 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-bb3f1a9b-e15b-435e-be9b-bfcbd84ac899 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:26.337235 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-bb3f1a9b-e15b-435e-be9b-bfcbd84ac899 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:26.347639 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bb3f1a9b-e15b-435e-be9b-bfcbd84ac899 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.348131 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bb3f1a9b-e15b-435e-be9b-bfcbd84ac899 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.348996 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bb3f1a9b-e15b-435e-be9b-bfcbd84ac899 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.349483 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bb3f1a9b-e15b-435e-be9b-bfcbd84ac899 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.481776 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-bb3f1a9b-e15b-435e-be9b-bfcbd84ac899 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:26.490596 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-bb3f1a9b-e15b-435e-be9b-bfcbd84ac899 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.161841 May 17 18:18:26.501262 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 436/854] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:26 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:26.557016 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2320088b-ace4-4c5c-a27a-d0a3f83c91e6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:26.557742 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2320088b-ace4-4c5c-a27a-d0a3f83c91e6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:26.564105 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2320088b-ace4-4c5c-a27a-d0a3f83c91e6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.564729 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2320088b-ace4-4c5c-a27a-d0a3f83c91e6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.566111 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2320088b-ace4-4c5c-a27a-d0a3f83c91e6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.566656 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2320088b-ace4-4c5c-a27a-d0a3f83c91e6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.729464 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2320088b-ace4-4c5c-a27a-d0a3f83c91e6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:26.730769 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-db5fc2b1-cc6a-4fc5-9602-72c06915a4bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:26.731421 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-db5fc2b1-cc6a-4fc5-9602-72c06915a4bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:26.737168 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2320088b-ace4-4c5c-a27a-d0a3f83c91e6 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1367 microversion: 2.1 time: 0.184018 May 17 18:18:26.738482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 419/855] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:26 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:26.743661 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-db5fc2b1-cc6a-4fc5-9602-72c06915a4bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.744569 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-db5fc2b1-cc6a-4fc5-9602-72c06915a4bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.745640 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-db5fc2b1-cc6a-4fc5-9602-72c06915a4bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.746256 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-db5fc2b1-cc6a-4fc5-9602-72c06915a4bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.819068 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-d163629a-8bd6-4aa8-8aae-90f820040dc8 req-92fd03ee-465e-4a72-a7f0-6998be9431d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530a3eb3-cd60-4f22-a693-6221a19eea5f", "name": "network-vif-deleted", "tag": "64d89cb2-8631-49b0-85a0-7b9cbfbbffb0"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:26.825324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-db5fc2b1-cc6a-4fc5-9602-72c06915a4bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:26.827629 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-d163629a-8bd6-4aa8-8aae-90f820040dc8 req-92fd03ee-465e-4a72-a7f0-6998be9431d6 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.828086 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-d163629a-8bd6-4aa8-8aae-90f820040dc8 req-92fd03ee-465e-4a72-a7f0-6998be9431d6 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.834191 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-db5fc2b1-cc6a-4fc5-9602-72c06915a4bb tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1480 microversion: 2.1 time: 0.111946 May 17 18:18:26.834972 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 437/856] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:26 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1480 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:26.840555 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-d163629a-8bd6-4aa8-8aae-90f820040dc8 req-92fd03ee-465e-4a72-a7f0-6998be9431d6 service nova] Creating event network-vif-deleted:64d89cb2-8631-49b0-85a0-7b9cbfbbffb0 for instance 530a3eb3-cd60-4f22-a693-6221a19eea5f on hv-cinder-84130 May 17 18:18:26.845386 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-d163629a-8bd6-4aa8-8aae-90f820040dc8 req-92fd03ee-465e-4a72-a7f0-6998be9431d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030877 May 17 18:18:26.845975 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 420/857] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:18:27.285735 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4a21eb32-cf1b-463c-8e54-f94e32f7d67b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:27.286268 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4a21eb32-cf1b-463c-8e54-f94e32f7d67b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:27.292251 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4a21eb32-cf1b-463c-8e54-f94e32f7d67b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.292709 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4a21eb32-cf1b-463c-8e54-f94e32f7d67b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.293486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4a21eb32-cf1b-463c-8e54-f94e32f7d67b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.294082 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4a21eb32-cf1b-463c-8e54-f94e32f7d67b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.319898 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-4a21eb32-cf1b-463c-8e54-f94e32f7d67b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lazy-loading 'flavor' on Instance uuid 1b911090-a501-452a-a039-bb3a83c3055b {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:18:27.511316 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ae3d93b7-8d1f-4635-8094-b4def4b1d44a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:27.512155 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ae3d93b7-8d1f-4635-8094-b4def4b1d44a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:27.518990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ae3d93b7-8d1f-4635-8094-b4def4b1d44a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.519782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ae3d93b7-8d1f-4635-8094-b4def4b1d44a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.520717 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ae3d93b7-8d1f-4635-8094-b4def4b1d44a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.521712 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ae3d93b7-8d1f-4635-8094-b4def4b1d44a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.689035 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ae3d93b7-8d1f-4635-8094-b4def4b1d44a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:27.705501 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ae3d93b7-8d1f-4635-8094-b4def4b1d44a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1363 microversion: 2.1 time: 0.198653 May 17 18:18:27.707182 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 421/858] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:27 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:27.748420 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4a21eb32-cf1b-463c-8e54-f94e32f7d67b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "POST /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/action" status: 202 len: 0 microversion: 2.20 time: 0.466160 May 17 18:18:27.749609 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 438/859] 10.222.0.25 () {62 vars in 1318 bytes} [Tue May 17 18:18:27 2022] POST /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:18:27.757989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-33a48646-ca39-4bba-b561-717d04e92c16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:27.758969 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-33a48646-ca39-4bba-b561-717d04e92c16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:27.765262 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33a48646-ca39-4bba-b561-717d04e92c16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.765727 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6ac02afa-5045-424f-aa59-40204fb98493 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:27.766131 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33a48646-ca39-4bba-b561-717d04e92c16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.767229 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33a48646-ca39-4bba-b561-717d04e92c16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.767373 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6ac02afa-5045-424f-aa59-40204fb98493 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:27.768075 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33a48646-ca39-4bba-b561-717d04e92c16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.777887 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ac02afa-5045-424f-aa59-40204fb98493 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.778362 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ac02afa-5045-424f-aa59-40204fb98493 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.780308 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ac02afa-5045-424f-aa59-40204fb98493 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.780939 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6ac02afa-5045-424f-aa59-40204fb98493 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.026117 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6ac02afa-5045-424f-aa59-40204fb98493 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:28.030853 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-33a48646-ca39-4bba-b561-717d04e92c16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:28.035308 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6ac02afa-5045-424f-aa59-40204fb98493 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1557 microversion: 2.1 time: 0.275036 May 17 18:18:28.035888 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 439/860] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:27 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1557 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:28.041240 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:28.042274 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:28.042398 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-33a48646-ca39-4bba-b561-717d04e92c16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:28.044378 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-33a48646-ca39-4bba-b561-717d04e92c16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:28.045701 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-33a48646-ca39-4bba-b561-717d04e92c16 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.291632 May 17 18:18:28.046446 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 422/861] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:27 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:28.051799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.052298 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.053017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.053451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.062733 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ddc46521-e921-448a-a98c-1d743f5bf66a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:28.063237 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ddc46521-e921-448a-a98c-1d743f5bf66a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:28.070847 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ddc46521-e921-448a-a98c-1d743f5bf66a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.071362 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ddc46521-e921-448a-a98c-1d743f5bf66a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.072283 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ddc46521-e921-448a-a98c-1d743f5bf66a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.072730 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ddc46521-e921-448a-a98c-1d743f5bf66a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.093285 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.093671 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.094451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lazy-loading 'fault' on Instance uuid 530a3eb3-cd60-4f22-a693-6221a19eea5f {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:18:28.163617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9f27a865b468989f672a05dbab350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e7b68f0464827afc5ed835cee1d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:28.171000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-78ceec1f-2520-4fe1-9b00-f89ca7ed7aef tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 200 len: 1312 microversion: 2.1 time: 0.133893 May 17 18:18:28.171836 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 440/862] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:28 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:28.180745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ddc46521-e921-448a-a98c-1d743f5bf66a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124742 May 17 18:18:28.181647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 423/863] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 17 18:18:28 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:28.724878 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-957dde88-05ec-42d6-bcb3-a0845097ae97 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:28.725582 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-957dde88-05ec-42d6-bcb3-a0845097ae97 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:28.732771 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-957dde88-05ec-42d6-bcb3-a0845097ae97 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.733650 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-957dde88-05ec-42d6-bcb3-a0845097ae97 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.734539 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-957dde88-05ec-42d6-bcb3-a0845097ae97 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.735198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-957dde88-05ec-42d6-bcb3-a0845097ae97 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.974837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-957dde88-05ec-42d6-bcb3-a0845097ae97 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:28.982201 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-957dde88-05ec-42d6-bcb3-a0845097ae97 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1550 microversion: 2.1 time: 0.262187 May 17 18:18:28.982839 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 441/864] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:28 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1550 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:29.000569 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f63a76c5-07c5-453f-a439-1bd72334c0f3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:29.001060 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f63a76c5-07c5-453f-a439-1bd72334c0f3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:29.007644 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f63a76c5-07c5-453f-a439-1bd72334c0f3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.008108 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f63a76c5-07c5-453f-a439-1bd72334c0f3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.008882 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f63a76c5-07c5-453f-a439-1bd72334c0f3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.009315 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f63a76c5-07c5-453f-a439-1bd72334c0f3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.072073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7506bcc9-4ca4-434a-a5cc-19f0de51dad4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:29.072967 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7506bcc9-4ca4-434a-a5cc-19f0de51dad4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:29.080239 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7506bcc9-4ca4-434a-a5cc-19f0de51dad4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.081224 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7506bcc9-4ca4-434a-a5cc-19f0de51dad4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.082251 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7506bcc9-4ca4-434a-a5cc-19f0de51dad4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.082992 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7506bcc9-4ca4-434a-a5cc-19f0de51dad4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.120169 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f63a76c5-07c5-453f-a439-1bd72334c0f3 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123940 May 17 18:18:29.121329 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 424/865] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 17 18:18:28 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:29.188959 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9822f78f-880b-412a-97f9-0376fcf94528 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:29.189993 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9822f78f-880b-412a-97f9-0376fcf94528 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] [instance: 530a3eb3-cd60-4f22-a693-6221a19eea5f] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:29.197493 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9822f78f-880b-412a-97f9-0376fcf94528 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.198328 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9822f78f-880b-412a-97f9-0376fcf94528 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.199402 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9822f78f-880b-412a-97f9-0376fcf94528 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.200071 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9822f78f-880b-412a-97f9-0376fcf94528 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.219621 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-9822f78f-880b-412a-97f9-0376fcf94528 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] HTTP exception thrown: Instance 530a3eb3-cd60-4f22-a693-6221a19eea5f could not be found. May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9822f78f-880b-412a-97f9-0376fcf94528 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Request method failure captured: May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f HTTP/1.1 May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WzWKI_qp77YHLeymkbA2nMR_qjOtmmqk6FaK9Yh75xjb8QQi3BjnX6MQP8riZ5sjsky4n7JVdRB8b1lc7H08V0xUoslnGDT-ip1glIuAAu0KM-xhJdoQgc3lKpgHfXh5chSWnW0mA98TTJaSlVnRvKoUQkzDfbsJt1EL74HYlh9BI May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: e32e7b68f0464827afc5ed835cee1d15 May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:18:29.221678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e32e7b68f0464827afc5ed835cee1d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e32e7b68f0464827afc5ed835cee1d15", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: e32e7b68f0464827afc5ed835cee1d15 May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1083069676 May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-ServerRescueNegativeTestJSON-1083069676-project May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 62a9f27a865b468989f672a05dbab350 May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1083069676-project May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 530a3eb3-cd60-4f22-a693-6221a19eea5f could not be found. May 17 18:18:29.223057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '530a3eb3-cd60-4f22-a693-6221a19eea5f'} May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 530a3eb3-cd60-4f22-a693-6221a19eea5f could not be found. May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:29.223783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 530a3eb3-cd60-4f22-a693-6221a19eea5f could not be found. May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 530a3eb3-cd60-4f22-a693-6221a19eea5f could not be found. May 17 18:18:29.225022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:29.228304 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9822f78f-880b-412a-97f9-0376fcf94528 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] Returning 404 to user: Instance 530a3eb3-cd60-4f22-a693-6221a19eea5f could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:29.229722 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9822f78f-880b-412a-97f9-0376fcf94528 tempest-ServerRescueNegativeTestJSON-1083069676 tempest-ServerRescueNegativeTestJSON-1083069676-project] 10.222.0.25 "GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f" status: 404 len: 111 microversion: 2.1 time: 0.044922 May 17 18:18:29.230893 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 425/866] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:18:29 2022] GET /compute/v2.1/servers/530a3eb3-cd60-4f22-a693-6221a19eea5f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:29.591953 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7506bcc9-4ca4-434a-a5cc-19f0de51dad4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:29.600781 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7506bcc9-4ca4-434a-a5cc-19f0de51dad4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:29.602377 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7506bcc9-4ca4-434a-a5cc-19f0de51dad4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:29.615757 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7506bcc9-4ca4-434a-a5cc-19f0de51dad4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.551863 May 17 18:18:29.616662 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 442/867] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:29 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:30.371243 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-f862af7d-d61d-45ee-adf3-fc1fab28de0f req-818a263b-d7a7-4f0b-8bfd-2e007696919e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f36d239-5a80-418e-9e5c-ace79af53f6e", "tag": "6f151f25-60f1-4b8c-87db-feea63856248"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:30.381133 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-f862af7d-d61d-45ee-adf3-fc1fab28de0f req-818a263b-d7a7-4f0b-8bfd-2e007696919e service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.381857 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-f862af7d-d61d-45ee-adf3-fc1fab28de0f req-818a263b-d7a7-4f0b-8bfd-2e007696919e service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:30.408076 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-f862af7d-d61d-45ee-adf3-fc1fab28de0f req-818a263b-d7a7-4f0b-8bfd-2e007696919e service nova] Creating event network-changed:6f151f25-60f1-4b8c-87db-feea63856248 for instance 5f36d239-5a80-418e-9e5c-ace79af53f6e on hv-cinder-84130 May 17 18:18:30.417804 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-f862af7d-d61d-45ee-adf3-fc1fab28de0f req-818a263b-d7a7-4f0b-8bfd-2e007696919e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144270 May 17 18:18:30.419938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 426/868] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:30.634552 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a9d153dc-fe85-4dab-9667-39be12ed58ad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:30.635724 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a9d153dc-fe85-4dab-9667-39be12ed58ad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:30.642016 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a9d153dc-fe85-4dab-9667-39be12ed58ad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.642466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a9d153dc-fe85-4dab-9667-39be12ed58ad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:30.643374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a9d153dc-fe85-4dab-9667-39be12ed58ad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.644536 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a9d153dc-fe85-4dab-9667-39be12ed58ad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:31.060795 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a9d153dc-fe85-4dab-9667-39be12ed58ad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:31.071115 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a9d153dc-fe85-4dab-9667-39be12ed58ad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:31.072940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a9d153dc-fe85-4dab-9667-39be12ed58ad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:31.074314 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a9d153dc-fe85-4dab-9667-39be12ed58ad tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.443705 May 17 18:18:31.075449 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 443/869] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:30 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:32.094812 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d6a84e14-3861-401c-85d6-9a3ec3845637 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:32.099523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d6a84e14-3861-401c-85d6-9a3ec3845637 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:32.122378 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d6a84e14-3861-401c-85d6-9a3ec3845637 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:32.124112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d6a84e14-3861-401c-85d6-9a3ec3845637 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:32.127315 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d6a84e14-3861-401c-85d6-9a3ec3845637 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:32.128436 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d6a84e14-3861-401c-85d6-9a3ec3845637 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:32.424549 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d6a84e14-3861-401c-85d6-9a3ec3845637 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:32.435996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d6a84e14-3861-401c-85d6-9a3ec3845637 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:32.437907 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d6a84e14-3861-401c-85d6-9a3ec3845637 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:32.439371 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d6a84e14-3861-401c-85d6-9a3ec3845637 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.349192 May 17 18:18:32.440958 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 427/870] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:32 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:32.585342 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-8677aa80-3423-4d36-bb75-27c88d152dd3 req-11e4a162-3d6f-4122-b97c-fdad360de980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1d264e-2d3a-4a16-9a14-1c7d756c620c", "tag": "c0c0c04b-f7a7-40fc-80b8-5514db09a6c9"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:32.599891 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-8677aa80-3423-4d36-bb75-27c88d152dd3 req-11e4a162-3d6f-4122-b97c-fdad360de980 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:32.600779 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-8677aa80-3423-4d36-bb75-27c88d152dd3 req-11e4a162-3d6f-4122-b97c-fdad360de980 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:32.618233 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-8677aa80-3423-4d36-bb75-27c88d152dd3 req-11e4a162-3d6f-4122-b97c-fdad360de980 service nova] Creating event network-changed:c0c0c04b-f7a7-40fc-80b8-5514db09a6c9 for instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c on hv-cinder-84130 May 17 18:18:32.624755 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-8677aa80-3423-4d36-bb75-27c88d152dd3 req-11e4a162-3d6f-4122-b97c-fdad360de980 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043445 May 17 18:18:32.625901 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 444/871] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:33.460745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1be40f62-8cda-4d16-beba-7ddf3dcbf805 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:33.462984 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1be40f62-8cda-4d16-beba-7ddf3dcbf805 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:33.470907 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1be40f62-8cda-4d16-beba-7ddf3dcbf805 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.472255 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1be40f62-8cda-4d16-beba-7ddf3dcbf805 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.473268 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1be40f62-8cda-4d16-beba-7ddf3dcbf805 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.473706 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1be40f62-8cda-4d16-beba-7ddf3dcbf805 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.607588 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1be40f62-8cda-4d16-beba-7ddf3dcbf805 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:33.616285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1be40f62-8cda-4d16-beba-7ddf3dcbf805 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:33.617773 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1be40f62-8cda-4d16-beba-7ddf3dcbf805 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:33.618959 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1be40f62-8cda-4d16-beba-7ddf3dcbf805 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.163194 May 17 18:18:33.619513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 428/872] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:33 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:34.639478 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-87f3e282-e339-46e5-8770-5605402eff54 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:34.641229 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-87f3e282-e339-46e5-8770-5605402eff54 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:34.648461 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-87f3e282-e339-46e5-8770-5605402eff54 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:34.648922 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-87f3e282-e339-46e5-8770-5605402eff54 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:34.649701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-87f3e282-e339-46e5-8770-5605402eff54 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:34.650139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-87f3e282-e339-46e5-8770-5605402eff54 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:34.810005 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-87f3e282-e339-46e5-8770-5605402eff54 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:34.819189 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-87f3e282-e339-46e5-8770-5605402eff54 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:34.820886 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-87f3e282-e339-46e5-8770-5605402eff54 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:34.822323 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-87f3e282-e339-46e5-8770-5605402eff54 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.188469 May 17 18:18:34.822908 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 445/873] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:34 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:35.840885 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-97f27053-aa4a-4da6-acda-532d4934c9b7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:35.841505 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-97f27053-aa4a-4da6-acda-532d4934c9b7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:35.848824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-97f27053-aa4a-4da6-acda-532d4934c9b7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:35.849283 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-97f27053-aa4a-4da6-acda-532d4934c9b7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:35.850059 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-97f27053-aa4a-4da6-acda-532d4934c9b7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:35.850497 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-97f27053-aa4a-4da6-acda-532d4934c9b7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:35.984350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-97f27053-aa4a-4da6-acda-532d4934c9b7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:35.992456 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-97f27053-aa4a-4da6-acda-532d4934c9b7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:35.993963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-97f27053-aa4a-4da6-acda-532d4934c9b7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:35.995181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-97f27053-aa4a-4da6-acda-532d4934c9b7 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.158121 May 17 18:18:35.995739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 429/874] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:35 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:37.013563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-efa4b610-a48b-4fa5-be09-2d13c95588ae tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:37.014181 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-efa4b610-a48b-4fa5-be09-2d13c95588ae tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:37.021118 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-efa4b610-a48b-4fa5-be09-2d13c95588ae tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:37.021513 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-efa4b610-a48b-4fa5-be09-2d13c95588ae tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:37.022285 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-efa4b610-a48b-4fa5-be09-2d13c95588ae tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:37.022758 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-efa4b610-a48b-4fa5-be09-2d13c95588ae tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:37.154342 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-efa4b610-a48b-4fa5-be09-2d13c95588ae tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:37.162529 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-efa4b610-a48b-4fa5-be09-2d13c95588ae tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:37.164086 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-efa4b610-a48b-4fa5-be09-2d13c95588ae tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:37.165236 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-efa4b610-a48b-4fa5-be09-2d13c95588ae tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.155935 May 17 18:18:37.165791 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 446/875] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:37 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:37.326668 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ca6d0912-e79d-4b99-9295-975e733be09f tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74bcf59940>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:37.376048 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ca6d0912-e79d-4b99-9295-975e733be09f tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/80c81dc5-c73f-4365-8bd0-bfb8a443f046" status: 200 len: 350 microversion: 2.1 time: 0.052989 May 17 18:18:37.376672 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 430/876] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:18:37 2022] GET /compute/v2.1/os-volumes/80c81dc5-c73f-4365-8bd0-bfb8a443f046 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:38.183880 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-151d0cc0-23d0-4f5a-9cae-a286d2142013 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:38.184486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-151d0cc0-23d0-4f5a-9cae-a286d2142013 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:38.191592 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-151d0cc0-23d0-4f5a-9cae-a286d2142013 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:38.192078 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-151d0cc0-23d0-4f5a-9cae-a286d2142013 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:38.193103 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-151d0cc0-23d0-4f5a-9cae-a286d2142013 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:38.193601 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-151d0cc0-23d0-4f5a-9cae-a286d2142013 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:38.319203 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-151d0cc0-23d0-4f5a-9cae-a286d2142013 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:38.326856 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-151d0cc0-23d0-4f5a-9cae-a286d2142013 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:38.328371 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-151d0cc0-23d0-4f5a-9cae-a286d2142013 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:38.329516 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-151d0cc0-23d0-4f5a-9cae-a286d2142013 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.149568 May 17 18:18:38.330066 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 447/877] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:38 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:38.679446 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-16480f30-1ec7-48e3-977d-a2f4ea145953 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74bcf5f820>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:38.725639 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-16480f30-1ec7-48e3-977d-a2f4ea145953 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e9bc78ce-b360-489a-849e-11dd358da4d4" status: 200 len: 350 microversion: 2.1 time: 0.050362 May 17 18:18:38.726203 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 431/878] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:18:38 2022] GET /compute/v2.1/os-volumes/e9bc78ce-b360-489a-849e-11dd358da4d4 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:39.348600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7f0dc2b7-eaa0-4a8e-9da5-56b1c6ad513f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:39.349125 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7f0dc2b7-eaa0-4a8e-9da5-56b1c6ad513f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:39.355545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f0dc2b7-eaa0-4a8e-9da5-56b1c6ad513f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:39.355992 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f0dc2b7-eaa0-4a8e-9da5-56b1c6ad513f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:39.356752 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f0dc2b7-eaa0-4a8e-9da5-56b1c6ad513f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:39.357182 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f0dc2b7-eaa0-4a8e-9da5-56b1c6ad513f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:39.485362 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7f0dc2b7-eaa0-4a8e-9da5-56b1c6ad513f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:39.493602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7f0dc2b7-eaa0-4a8e-9da5-56b1c6ad513f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:39.495123 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7f0dc2b7-eaa0-4a8e-9da5-56b1c6ad513f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:39.496271 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7f0dc2b7-eaa0-4a8e-9da5-56b1c6ad513f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.152251 May 17 18:18:39.496822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 448/879] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:39 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:40.035666 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-213a90d9-de7c-41b4-84e3-8194c1255e0a tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74bcfae1f0>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.080675 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-213a90d9-de7c-41b4-84e3-8194c1255e0a tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/68a87537-a809-4025-8835-0f623a680d44" status: 200 len: 350 microversion: 2.1 time: 0.051783 May 17 18:18:40.081869 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 432/880] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/os-volumes/68a87537-a809-4025-8835-0f623a680d44 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:40.093200 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d1792d16-5e02-4568-bfa6-968be6c3c2b6 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74bcdf5040>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.173372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d1792d16-5e02-4568-bfa6-968be6c3c2b6 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.084387 May 17 18:18:40.173974 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 449/881] 10.222.0.25 () {58 vars in 1133 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:40.185818 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a8967da8-9653-400a-abba-0b3c669516ab tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74abc9a430>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.263640 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a8967da8-9653-400a-abba-0b3c669516ab tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.081633 May 17 18:18:40.264213 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 433/882] 10.222.0.25 () {58 vars in 1148 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:40.275679 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4cc81580-c219-41f2-bae9-cbe45dae6565 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74ab55dca0>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.355755 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4cc81580-c219-41f2-bae9-cbe45dae6565 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.083818 May 17 18:18:40.357120 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 450/883] 10.222.0.25 () {58 vars in 1133 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:40.367739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-65268994-8870-4040-9996-fc278e43090a tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74bcfc9f70>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.445328 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-65268994-8870-4040-9996-fc278e43090a tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081324 May 17 18:18:40.445902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 434/884] 10.222.0.25 () {58 vars in 1166 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:40.457444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a1304179-a8af-4f13-bb51-f8cad0b95897 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74ab55d040>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.513672 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ddeb5100-b7ce-4ff3-bbcf-c3e14937c369 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.514276 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ddeb5100-b7ce-4ff3-bbcf-c3e14937c369 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:40.520885 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ddeb5100-b7ce-4ff3-bbcf-c3e14937c369 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:40.521331 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ddeb5100-b7ce-4ff3-bbcf-c3e14937c369 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:40.522093 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ddeb5100-b7ce-4ff3-bbcf-c3e14937c369 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:40.522536 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ddeb5100-b7ce-4ff3-bbcf-c3e14937c369 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:40.535644 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a1304179-a8af-4f13-bb51-f8cad0b95897 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.082061 May 17 18:18:40.536215 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 451/885] 10.222.0.25 () {58 vars in 1169 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:40.547594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-81f04db3-25db-4215-9105-1519c2803505 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74bcdf51f0>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.630447 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-81f04db3-25db-4215-9105-1519c2803505 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.086323 May 17 18:18:40.631052 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 452/886] 10.222.0.25 () {58 vars in 1154 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:40.641527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-490f290a-3bb5-4b4b-9418-991ab5b2a76d tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74ab5ab310>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.654114 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ddeb5100-b7ce-4ff3-bbcf-c3e14937c369 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:40.662709 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ddeb5100-b7ce-4ff3-bbcf-c3e14937c369 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:40.664268 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ddeb5100-b7ce-4ff3-bbcf-c3e14937c369 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:40.665418 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ddeb5100-b7ce-4ff3-bbcf-c3e14937c369 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.155939 May 17 18:18:40.665969 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 435/887] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:40.723267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-490f290a-3bb5-4b4b-9418-991ab5b2a76d tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085207 May 17 18:18:40.723834 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 453/888] 10.222.0.25 () {58 vars in 1187 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:18:40.735016 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-959accf1-8066-42a6-94ba-aab97695d2e5 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] Calling method '.version_select at 0x7f74bcff9b80>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.820529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-959accf1-8066-42a6-94ba-aab97695d2e5 tempest-VolumesTestJSON-1210592314 tempest-VolumesTestJSON-1210592314-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.089162 May 17 18:18:40.821215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 436/889] 10.222.0.25 () {58 vars in 1154 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:41.684312 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-de59bd6f-063d-4887-ad21-21a126799f49 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:41.684929 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-de59bd6f-063d-4887-ad21-21a126799f49 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:41.691073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-de59bd6f-063d-4887-ad21-21a126799f49 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:41.691529 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-de59bd6f-063d-4887-ad21-21a126799f49 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:41.692298 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-de59bd6f-063d-4887-ad21-21a126799f49 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:41.692987 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-de59bd6f-063d-4887-ad21-21a126799f49 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:41.817230 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-de59bd6f-063d-4887-ad21-21a126799f49 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:41.825205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-de59bd6f-063d-4887-ad21-21a126799f49 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:41.826736 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-de59bd6f-063d-4887-ad21-21a126799f49 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:41.827903 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-de59bd6f-063d-4887-ad21-21a126799f49 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.147950 May 17 18:18:41.828461 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 454/890] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:41 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:42.847453 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bf07e8ac-9cc0-4506-b230-fb64bd1d6dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:42.848067 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-bf07e8ac-9cc0-4506-b230-fb64bd1d6dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:42.854767 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bf07e8ac-9cc0-4506-b230-fb64bd1d6dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:42.855231 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bf07e8ac-9cc0-4506-b230-fb64bd1d6dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:42.856002 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bf07e8ac-9cc0-4506-b230-fb64bd1d6dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:42.856444 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bf07e8ac-9cc0-4506-b230-fb64bd1d6dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:42.986811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-bf07e8ac-9cc0-4506-b230-fb64bd1d6dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:42.994608 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-bf07e8ac-9cc0-4506-b230-fb64bd1d6dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:42.996097 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-bf07e8ac-9cc0-4506-b230-fb64bd1d6dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:42.997250 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-bf07e8ac-9cc0-4506-b230-fb64bd1d6dcd tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.154265 May 17 18:18:42.997813 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 437/891] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:42 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:44.015711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f23cb68e-976b-41cf-8a70-1561796d9a47 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:44.016324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f23cb68e-976b-41cf-8a70-1561796d9a47 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:44.023444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f23cb68e-976b-41cf-8a70-1561796d9a47 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:44.023902 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f23cb68e-976b-41cf-8a70-1561796d9a47 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:44.024675 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f23cb68e-976b-41cf-8a70-1561796d9a47 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:44.025112 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f23cb68e-976b-41cf-8a70-1561796d9a47 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:44.156813 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f23cb68e-976b-41cf-8a70-1561796d9a47 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:44.165232 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f23cb68e-976b-41cf-8a70-1561796d9a47 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:44.166791 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f23cb68e-976b-41cf-8a70-1561796d9a47 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:44.167947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f23cb68e-976b-41cf-8a70-1561796d9a47 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1745 microversion: 2.20 time: 0.156165 May 17 18:18:44.168508 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 455/892] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:44 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:45.189065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0baa724c-aea6-4a31-8079-10ea9dcc8cc4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:45.190540 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0baa724c-aea6-4a31-8079-10ea9dcc8cc4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:45.197072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0baa724c-aea6-4a31-8079-10ea9dcc8cc4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:45.197530 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0baa724c-aea6-4a31-8079-10ea9dcc8cc4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:45.198304 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0baa724c-aea6-4a31-8079-10ea9dcc8cc4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:45.198785 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0baa724c-aea6-4a31-8079-10ea9dcc8cc4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:45.337869 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0baa724c-aea6-4a31-8079-10ea9dcc8cc4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:45.345547 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0baa724c-aea6-4a31-8079-10ea9dcc8cc4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:45.347683 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-0baa724c-aea6-4a31-8079-10ea9dcc8cc4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:45.348844 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0baa724c-aea6-4a31-8079-10ea9dcc8cc4 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1745 microversion: 2.20 time: 0.166512 May 17 18:18:45.349490 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 438/893] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:45 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:45.527387 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-08a55528-9972-42b2-915c-ca8c9fee4ce5 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Action: 'create', calling method: .version_select at 0x7f74bcf3df70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1269454558", "metadata": {"Type": "work"}}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-08a55528-9972-42b2-915c-ca8c9fee4ce5 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Request method failure captured: May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 122 May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-cFgFb49sME7FPZI0ddSEVbIpsL2boxil2dAE_p6X4GIuXdZz-c_EhSjEpEAbD7a8kU8UpAXyrC_5A531iVDWbXPLXU5dSU794QaP2ReOquhKh2Mt9Hyd6tC5_7kHPPc3Z5CliRYHOMSNPc1yJUSXEyJY6_ZQNKRod8VDL-JUaHIQM May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:18:45.538920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de030295fc2e466ea895232faa0e5497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de030295fc2e466ea895232faa0e5497", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: f1711af1df924229bf77cccd2d4fe8c7 May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1269454558", "metadata": {"Type": "work"}}} May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: May 17 18:18:45.540667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1269454558', 'metadata': {'Type': 'work'}}}} May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise error May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi '#$%' May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:45.541680 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 18:18:45.543976 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 18:18:45.546184 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 18:18:45.546184 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.546184 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-08a55528-9972-42b2-915c-ca8c9fee4ce5 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:45.546184 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-08a55528-9972-42b2-915c-ca8c9fee4ce5 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.124138 May 17 18:18:45.546184 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 456/894] 10.222.0.25 () {60 vars in 1155 bytes} [Tue May 17 18:18:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 18:18:45.550353 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-320af312-60eb-4e8b-b1a2-70b60db6e1a8 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Action: 'create', calling method: .version_select at 0x7f74abdafdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-370676117", "metadata": {"Type": "work"}}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-320af312-60eb-4e8b-b1a2-70b60db6e1a8 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Request method failure captured: May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 119 May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-cFgFb49sME7FPZI0ddSEVbIpsL2boxil2dAE_p6X4GIuXdZz-c_EhSjEpEAbD7a8kU8UpAXyrC_5A531iVDWbXPLXU5dSU794QaP2ReOquhKh2Mt9Hyd6tC5_7kHPPc3Z5CliRYHOMSNPc1yJUSXEyJY6_ZQNKRod8VDL-JUaHIQM May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:18:45.553645 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de030295fc2e466ea895232faa0e5497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de030295fc2e466ea895232faa0e5497", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: f1711af1df924229bf77cccd2d4fe8c7 May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-370676117", "metadata": {"Type": "work"}}} May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: May 17 18:18:45.555692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-370676117', 'metadata': {'Type': 'work'}}}} May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise error May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi '0' May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:45.556580 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 18:18:45.558100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 18:18:45.559250 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 18:18:45.559250 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.559250 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-320af312-60eb-4e8b-b1a2-70b60db6e1a8 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:45.559250 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-320af312-60eb-4e8b-b1a2-70b60db6e1a8 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008730 May 17 18:18:45.559250 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 439/895] 10.222.0.25 () {60 vars in 1155 bytes} [Tue May 17 18:18:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 18:18:45.564590 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4163bd8a-d8d3-41c0-a1c0-e85091742cdf tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Action: 'create', calling method: .version_select at 0x7f74bcf85d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1977910083", "metadata": {"Type": "work"}}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4163bd8a-d8d3-41c0-a1c0-e85091742cdf tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Request method failure captured: May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 119 May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-cFgFb49sME7FPZI0ddSEVbIpsL2boxil2dAE_p6X4GIuXdZz-c_EhSjEpEAbD7a8kU8UpAXyrC_5A531iVDWbXPLXU5dSU794QaP2ReOquhKh2Mt9Hyd6tC5_7kHPPc3Z5CliRYHOMSNPc1yJUSXEyJY6_ZQNKRod8VDL-JUaHIQM May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:18:45.567881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de030295fc2e466ea895232faa0e5497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de030295fc2e466ea895232faa0e5497", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: f1711af1df924229bf77cccd2d4fe8c7 May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1977910083", "metadata": {"Type": "work"}}} May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: May 17 18:18:45.569600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1977910083', 'metadata': {'Type': 'work'}}}} May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise error May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi '' May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:45.570711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 18:18:45.572257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 18:18:45.573473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 18:18:45.573473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.573473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4163bd8a-d8d3-41c0-a1c0-e85091742cdf tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:45.573473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4163bd8a-d8d3-41c0-a1c0-e85091742cdf tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008737 May 17 18:18:45.573473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 457/896] 10.222.0.25 () {60 vars in 1155 bytes} [Tue May 17 18:18:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 17 18:18:45.579910 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9f2c9784-5eab-42fe-a956-1241df5f27c1 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Calling method '.version_select at 0x7f74bcfae040>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:45.610979 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-9f2c9784-5eab-42fe-a956-1241df5f27c1 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] HTTP exception thrown: Volume tempest-invalid-2101115744 could not be found. May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9f2c9784-5eab-42fe-a956-1241df5f27c1 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Request method failure captured: May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2101115744 HTTP/1.1 May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-cFgFb49sME7FPZI0ddSEVbIpsL2boxil2dAE_p6X4GIuXdZz-c_EhSjEpEAbD7a8kU8UpAXyrC_5A531iVDWbXPLXU5dSU794QaP2ReOquhKh2Mt9Hyd6tC5_7kHPPc3Z5CliRYHOMSNPc1yJUSXEyJY6_ZQNKRod8VDL-JUaHIQM May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:18:45.613904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de030295fc2e466ea895232faa0e5497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de030295fc2e466ea895232faa0e5497", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: f1711af1df924229bf77cccd2d4fe8c7 May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Volume tempest-invalid-2101115744 could not be found. May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': 'tempest-invalid-2101115744'} May 17 18:18:45.615523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2101115744 could not be found. (HTTP 404) (Request-ID: req-62503781-783c-4a87-b0ea-3f1233a7bc3d) May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.620482 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:18:45.622085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2101115744 could not be found. May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:45.623550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2101115744 could not be found. May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2101115744 could not be found. May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9f2c9784-5eab-42fe-a956-1241df5f27c1 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Returning 404 to user: Volume tempest-invalid-2101115744 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9f2c9784-5eab-42fe-a956-1241df5f27c1 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2101115744" status: 404 len: 99 microversion: 2.1 time: 0.040251 May 17 18:18:45.625027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 440/897] 10.222.0.25 () {58 vars in 1217 bytes} [Tue May 17 18:18:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2101115744 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 17 18:18:45.626755 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-903b5350-0fb7-49e1-87f3-efd36e56541d tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004267 May 17 18:18:45.630486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 458/898] 10.222.0.25 () {58 vars in 1139 bytes} [Tue May 17 18:18:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 18:18:45.635474 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fdcbd1f4-81c5-46a3-a26d-e374756240dd tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003747 May 17 18:18:45.635999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 441/899] 10.222.0.25 () {58 vars in 1136 bytes} [Tue May 17 18:18:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 17 18:18:45.645369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7c258226-c9a7-419d-b460-09844fcf4b2e tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Calling method '.version_select at 0x7f74bce4bb80>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:45.672393 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-7c258226-c9a7-419d-b460-09844fcf4b2e tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] HTTP exception thrown: Volume 7ceb0724-d19a-474a-83e1-d196bd6a3d24 could not be found. May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7c258226-c9a7-419d-b460-09844fcf4b2e tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Request method failure captured: May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: DELETE /compute/v2.1/os-volumes/7ceb0724-d19a-474a-83e1-d196bd6a3d24 HTTP/1.1 May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-cFgFb49sME7FPZI0ddSEVbIpsL2boxil2dAE_p6X4GIuXdZz-c_EhSjEpEAbD7a8kU8UpAXyrC_5A531iVDWbXPLXU5dSU794QaP2ReOquhKh2Mt9Hyd6tC5_7kHPPc3Z5CliRYHOMSNPc1yJUSXEyJY6_ZQNKRod8VDL-JUaHIQM May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:18:45.674982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de030295fc2e466ea895232faa0e5497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de030295fc2e466ea895232faa0e5497", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: f1711af1df924229bf77cccd2d4fe8c7 May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Volume 7ceb0724-d19a-474a-83e1-d196bd6a3d24 could not be found. May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '7ceb0724-d19a-474a-83e1-d196bd6a3d24'} May 17 18:18:45.676440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ceb0724-d19a-474a-83e1-d196bd6a3d24 could not be found. (HTTP 404) (Request-ID: req-25936edc-ba97-458e-80af-b67481d77377) May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.681370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:18:45.682750 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ceb0724-d19a-474a-83e1-d196bd6a3d24 could not be found. May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 18:18:45.684090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7ceb0724-d19a-474a-83e1-d196bd6a3d24 could not be found. May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ceb0724-d19a-474a-83e1-d196bd6a3d24 could not be found. May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7c258226-c9a7-419d-b460-09844fcf4b2e tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Returning 404 to user: Volume 7ceb0724-d19a-474a-83e1-d196bd6a3d24 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7c258226-c9a7-419d-b460-09844fcf4b2e tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/7ceb0724-d19a-474a-83e1-d196bd6a3d24" status: 404 len: 109 microversion: 2.1 time: 0.035717 May 17 18:18:45.685363 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 459/900] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 17 18:18:45 2022] DELETE /compute/v2.1/os-volumes/7ceb0724-d19a-474a-83e1-d196bd6a3d24 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:45.686383 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fa6db88e-2887-479c-962a-a1ab07a020a1 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Calling method '.version_select at 0x7f74abdafdc0>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:45.715203 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-fa6db88e-2887-479c-962a-a1ab07a020a1 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] HTTP exception thrown: Volume 7d52f055-0c80-41f0-86d4-432e53898cef could not be found. May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fa6db88e-2887-479c-962a-a1ab07a020a1 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Request method failure captured: May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/os-volumes/7d52f055-0c80-41f0-86d4-432e53898cef HTTP/1.1 May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-cFgFb49sME7FPZI0ddSEVbIpsL2boxil2dAE_p6X4GIuXdZz-c_EhSjEpEAbD7a8kU8UpAXyrC_5A531iVDWbXPLXU5dSU794QaP2ReOquhKh2Mt9Hyd6tC5_7kHPPc3Z5CliRYHOMSNPc1yJUSXEyJY6_ZQNKRod8VDL-JUaHIQM May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:18:45.717183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de030295fc2e466ea895232faa0e5497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de030295fc2e466ea895232faa0e5497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de030295fc2e466ea895232faa0e5497", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: de030295fc2e466ea895232faa0e5497 May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-VolumesNegativeTest-1482947210 May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: f1711af1df924229bf77cccd2d4fe8c7 May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-VolumesNegativeTest-1482947210-project May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Volume 7d52f055-0c80-41f0-86d4-432e53898cef could not be found. May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '7d52f055-0c80-41f0-86d4-432e53898cef'} May 17 18:18:45.718880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d52f055-0c80-41f0-86d4-432e53898cef could not be found. (HTTP 404) (Request-ID: req-77ef9b0f-14d3-47b4-a557-9c7eb3441ee8) May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.719782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:18:45.721201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d52f055-0c80-41f0-86d4-432e53898cef could not be found. May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 18:18:45.723072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d52f055-0c80-41f0-86d4-432e53898cef could not be found. May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d52f055-0c80-41f0-86d4-432e53898cef could not be found. May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fa6db88e-2887-479c-962a-a1ab07a020a1 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] Returning 404 to user: Volume 7d52f055-0c80-41f0-86d4-432e53898cef could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fa6db88e-2887-479c-962a-a1ab07a020a1 tempest-VolumesNegativeTest-1482947210 tempest-VolumesNegativeTest-1482947210-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/7d52f055-0c80-41f0-86d4-432e53898cef" status: 404 len: 109 microversion: 2.1 time: 0.036413 May 17 18:18:45.724225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 442/901] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 17 18:18:45 2022] GET /compute/v2.1/os-volumes/7d52f055-0c80-41f0-86d4-432e53898cef => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 18:18:46.367475 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-29738e54-3661-40e0-a1df-8384aa47e1ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:46.368094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-29738e54-3661-40e0-a1df-8384aa47e1ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:46.380787 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29738e54-3661-40e0-a1df-8384aa47e1ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.381533 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29738e54-3661-40e0-a1df-8384aa47e1ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.382486 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29738e54-3661-40e0-a1df-8384aa47e1ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.383291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-29738e54-3661-40e0-a1df-8384aa47e1ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.558062 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-29738e54-3661-40e0-a1df-8384aa47e1ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:46.578130 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-29738e54-3661-40e0-a1df-8384aa47e1ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:46.580156 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-29738e54-3661-40e0-a1df-8384aa47e1ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:46.582737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-29738e54-3661-40e0-a1df-8384aa47e1ba tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1740 microversion: 2.20 time: 0.219179 May 17 18:18:46.583679 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 460/902] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:46 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:47.603740 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4bb403bd-cb52-467a-98c9-7af32fe008b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:47.605016 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4bb403bd-cb52-467a-98c9-7af32fe008b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:47.616509 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4bb403bd-cb52-467a-98c9-7af32fe008b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:47.619207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4bb403bd-cb52-467a-98c9-7af32fe008b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:47.620024 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4bb403bd-cb52-467a-98c9-7af32fe008b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:47.620480 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4bb403bd-cb52-467a-98c9-7af32fe008b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:47.863643 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4bb403bd-cb52-467a-98c9-7af32fe008b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:47.872651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4bb403bd-cb52-467a-98c9-7af32fe008b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:47.875134 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4bb403bd-cb52-467a-98c9-7af32fe008b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:47.876477 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4bb403bd-cb52-467a-98c9-7af32fe008b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1740 microversion: 2.20 time: 0.277398 May 17 18:18:47.878259 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 443/903] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:47 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:48.901684 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a0b7886b-33d2-4e38-8940-e3e19901eb91 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:48.903354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a0b7886b-33d2-4e38-8940-e3e19901eb91 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:48.923674 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a0b7886b-33d2-4e38-8940-e3e19901eb91 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.925200 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a0b7886b-33d2-4e38-8940-e3e19901eb91 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:48.926034 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a0b7886b-33d2-4e38-8940-e3e19901eb91 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.926963 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a0b7886b-33d2-4e38-8940-e3e19901eb91 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:49.111367 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a0b7886b-33d2-4e38-8940-e3e19901eb91 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:49.125732 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a0b7886b-33d2-4e38-8940-e3e19901eb91 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:49.127619 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a0b7886b-33d2-4e38-8940-e3e19901eb91 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:49.130081 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a0b7886b-33d2-4e38-8940-e3e19901eb91 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1740 microversion: 2.20 time: 0.234227 May 17 18:18:49.130873 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 461/904] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:48 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:49.400454 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-ad5720ee-94f2-4de8-8beb-25d12a7a8d0d req-532392a4-1c58-46cd-adfe-67e3e119439b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b911090-a501-452a-a039-bb3a83c3055b", "name": "network-vif-plugged", "status": "completed", "tag": "616eb23c-cba6-4708-a5fb-a61c3ccb7b2c"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:49.419973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-ad5720ee-94f2-4de8-8beb-25d12a7a8d0d req-532392a4-1c58-46cd-adfe-67e3e119439b service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:49.421739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-ad5720ee-94f2-4de8-8beb-25d12a7a8d0d req-532392a4-1c58-46cd-adfe-67e3e119439b service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:49.448322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-ad5720ee-94f2-4de8-8beb-25d12a7a8d0d req-532392a4-1c58-46cd-adfe-67e3e119439b service nova] Creating event network-vif-plugged:616eb23c-cba6-4708-a5fb-a61c3ccb7b2c for instance 1b911090-a501-452a-a039-bb3a83c3055b on hv-cinder-84130 May 17 18:18:49.461233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-ad5720ee-94f2-4de8-8beb-25d12a7a8d0d req-532392a4-1c58-46cd-adfe-67e3e119439b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066221 May 17 18:18:49.468344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 444/905] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:18:50.148543 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-bd9852d6-9141-451c-a940-d8507a87f3ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:50.149142 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-bd9852d6-9141-451c-a940-d8507a87f3ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:50.161167 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bd9852d6-9141-451c-a940-d8507a87f3ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.161621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bd9852d6-9141-451c-a940-d8507a87f3ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.162621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bd9852d6-9141-451c-a940-d8507a87f3ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.163324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-bd9852d6-9141-451c-a940-d8507a87f3ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.726198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-bd9852d6-9141-451c-a940-d8507a87f3ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:50.734451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-bd9852d6-9141-451c-a940-d8507a87f3ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:50.740424 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-bd9852d6-9141-451c-a940-d8507a87f3ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:50.741771 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-bd9852d6-9141-451c-a940-d8507a87f3ef tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1740 microversion: 2.20 time: 0.597136 May 17 18:18:50.742561 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 462/906] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:50 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1740 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:51.762965 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-62d073c2-ed30-4a4e-9cfc-dbf586f83e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:51.763826 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-62d073c2-ed30-4a4e-9cfc-dbf586f83e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:51.772279 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-62d073c2-ed30-4a4e-9cfc-dbf586f83e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:51.773065 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-62d073c2-ed30-4a4e-9cfc-dbf586f83e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:51.774068 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-62d073c2-ed30-4a4e-9cfc-dbf586f83e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:51.774731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-62d073c2-ed30-4a4e-9cfc-dbf586f83e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:51.942777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-62d073c2-ed30-4a4e-9cfc-dbf586f83e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:51.953918 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-62d073c2-ed30-4a4e-9cfc-dbf586f83e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:51.956597 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-62d073c2-ed30-4a4e-9cfc-dbf586f83e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:51.957984 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-62d073c2-ed30-4a4e-9cfc-dbf586f83e3b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1740 microversion: 2.20 time: 0.200843 May 17 18:18:51.959211 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 445/907] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:51 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:52.977184 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-cbbf7a0e-6102-477a-97d6-f93a5a1969f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:52.978439 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-cbbf7a0e-6102-477a-97d6-f93a5a1969f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:52.988799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cbbf7a0e-6102-477a-97d6-f93a5a1969f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:52.989587 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cbbf7a0e-6102-477a-97d6-f93a5a1969f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:52.990556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cbbf7a0e-6102-477a-97d6-f93a5a1969f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:52.991412 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cbbf7a0e-6102-477a-97d6-f93a5a1969f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:53.148015 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-cbbf7a0e-6102-477a-97d6-f93a5a1969f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:53.156833 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-cbbf7a0e-6102-477a-97d6-f93a5a1969f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:53.159391 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-cbbf7a0e-6102-477a-97d6-f93a5a1969f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:53.162185 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-cbbf7a0e-6102-477a-97d6-f93a5a1969f1 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1740 microversion: 2.20 time: 0.189231 May 17 18:18:53.163714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 463/908] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:52 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:54.181405 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-727043a6-b87d-4865-a65d-c08bbd54c904 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:54.182163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-727043a6-b87d-4865-a65d-c08bbd54c904 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:54.195499 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-727043a6-b87d-4865-a65d-c08bbd54c904 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:54.195973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-727043a6-b87d-4865-a65d-c08bbd54c904 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:54.201853 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-727043a6-b87d-4865-a65d-c08bbd54c904 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:54.202351 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-727043a6-b87d-4865-a65d-c08bbd54c904 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:54.373068 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-727043a6-b87d-4865-a65d-c08bbd54c904 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:54.382542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-727043a6-b87d-4865-a65d-c08bbd54c904 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:54.384997 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-727043a6-b87d-4865-a65d-c08bbd54c904 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:54.386858 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-727043a6-b87d-4865-a65d-c08bbd54c904 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1740 microversion: 2.20 time: 0.209507 May 17 18:18:54.387528 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 446/909] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:54 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:55.405859 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-222661c6-e1ea-4f94-bb5d-81aa6fa64249 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:55.406516 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-222661c6-e1ea-4f94-bb5d-81aa6fa64249 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:55.414016 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-222661c6-e1ea-4f94-bb5d-81aa6fa64249 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:55.414555 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-222661c6-e1ea-4f94-bb5d-81aa6fa64249 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.415412 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-222661c6-e1ea-4f94-bb5d-81aa6fa64249 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:55.416056 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-222661c6-e1ea-4f94-bb5d-81aa6fa64249 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.560455 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-222661c6-e1ea-4f94-bb5d-81aa6fa64249 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:55.571137 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-222661c6-e1ea-4f94-bb5d-81aa6fa64249 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:55.572863 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-222661c6-e1ea-4f94-bb5d-81aa6fa64249 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:55.573851 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-222661c6-e1ea-4f94-bb5d-81aa6fa64249 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1740 microversion: 2.20 time: 0.172533 May 17 18:18:55.574673 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 464/910] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:55 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:56.592626 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d9278e44-86c1-43dd-a9aa-0c007a4bcfa9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:56.593340 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d9278e44-86c1-43dd-a9aa-0c007a4bcfa9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:56.600599 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d9278e44-86c1-43dd-a9aa-0c007a4bcfa9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:56.601101 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d9278e44-86c1-43dd-a9aa-0c007a4bcfa9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:56.601997 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d9278e44-86c1-43dd-a9aa-0c007a4bcfa9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:56.602439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d9278e44-86c1-43dd-a9aa-0c007a4bcfa9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:56.733887 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d9278e44-86c1-43dd-a9aa-0c007a4bcfa9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:56.742386 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d9278e44-86c1-43dd-a9aa-0c007a4bcfa9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:56.743948 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d9278e44-86c1-43dd-a9aa-0c007a4bcfa9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:56.745167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d9278e44-86c1-43dd-a9aa-0c007a4bcfa9 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1722 microversion: 2.20 time: 0.156558 May 17 18:18:56.745724 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 447/911] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:56 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:57.764283 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c0ff7d07-ee95-4379-9a72-2063cf59348d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:57.764899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c0ff7d07-ee95-4379-9a72-2063cf59348d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:57.771810 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c0ff7d07-ee95-4379-9a72-2063cf59348d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:57.772258 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c0ff7d07-ee95-4379-9a72-2063cf59348d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.773017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c0ff7d07-ee95-4379-9a72-2063cf59348d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:57.773456 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c0ff7d07-ee95-4379-9a72-2063cf59348d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.902138 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c0ff7d07-ee95-4379-9a72-2063cf59348d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:57.910063 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c0ff7d07-ee95-4379-9a72-2063cf59348d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:57.911630 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c0ff7d07-ee95-4379-9a72-2063cf59348d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:57.912783 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c0ff7d07-ee95-4379-9a72-2063cf59348d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1722 microversion: 2.20 time: 0.152473 May 17 18:18:57.913349 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 465/912] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:57 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:58.930944 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5c71758f-d484-4972-ad04-49bd1c72a3de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:58.931561 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5c71758f-d484-4972-ad04-49bd1c72a3de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:58.940268 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c71758f-d484-4972-ad04-49bd1c72a3de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:58.940834 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c71758f-d484-4972-ad04-49bd1c72a3de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:58.941791 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c71758f-d484-4972-ad04-49bd1c72a3de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:58.942232 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5c71758f-d484-4972-ad04-49bd1c72a3de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:59.071091 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5c71758f-d484-4972-ad04-49bd1c72a3de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:59.078845 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5c71758f-d484-4972-ad04-49bd1c72a3de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:59.080934 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5c71758f-d484-4972-ad04-49bd1c72a3de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:59.082009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5c71758f-d484-4972-ad04-49bd1c72a3de tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1722 microversion: 2.20 time: 0.154987 May 17 18:18:59.082585 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 448/913] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:18:58 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:00.100602 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fd1d666c-e8b7-4763-a59c-7d6f6dcbf478 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:00.101184 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-fd1d666c-e8b7-4763-a59c-7d6f6dcbf478 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:00.107479 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fd1d666c-e8b7-4763-a59c-7d6f6dcbf478 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:00.107933 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fd1d666c-e8b7-4763-a59c-7d6f6dcbf478 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:00.108695 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fd1d666c-e8b7-4763-a59c-7d6f6dcbf478 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:00.109134 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fd1d666c-e8b7-4763-a59c-7d6f6dcbf478 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:00.239679 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-fd1d666c-e8b7-4763-a59c-7d6f6dcbf478 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:00.247383 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-fd1d666c-e8b7-4763-a59c-7d6f6dcbf478 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:00.249019 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-fd1d666c-e8b7-4763-a59c-7d6f6dcbf478 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:00.250199 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-fd1d666c-e8b7-4763-a59c-7d6f6dcbf478 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1722 microversion: 2.20 time: 0.153573 May 17 18:19:00.250810 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 466/914] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:00 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:01.269490 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-132c73da-a650-4232-a4d9-e3da8fd0c36f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:01.270117 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-132c73da-a650-4232-a4d9-e3da8fd0c36f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:01.276513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-132c73da-a650-4232-a4d9-e3da8fd0c36f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.276972 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-132c73da-a650-4232-a4d9-e3da8fd0c36f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.277758 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-132c73da-a650-4232-a4d9-e3da8fd0c36f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.278201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-132c73da-a650-4232-a4d9-e3da8fd0c36f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.412087 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-132c73da-a650-4232-a4d9-e3da8fd0c36f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:01.420110 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-132c73da-a650-4232-a4d9-e3da8fd0c36f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:01.421674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-132c73da-a650-4232-a4d9-e3da8fd0c36f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:01.422865 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-132c73da-a650-4232-a4d9-e3da8fd0c36f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1665 microversion: 2.20 time: 0.157449 May 17 18:19:01.423445 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 449/915] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:01 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:01.441830 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9d58f307-2a80-4e89-a19c-d3c8ab8dd768 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3827fd7-55a8-413f-96b3-bb96ad5601b8"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:01.443313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9d58f307-2a80-4e89-a19c-d3c8ab8dd768 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:01.449560 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d58f307-2a80-4e89-a19c-d3c8ab8dd768 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.450003 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d58f307-2a80-4e89-a19c-d3c8ab8dd768 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.450806 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d58f307-2a80-4e89-a19c-d3c8ab8dd768 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.451245 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d58f307-2a80-4e89-a19c-d3c8ab8dd768 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.464136 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-2117bd52-5a9a-4438-ac6a-67d571b89204 req-e92759e5-b771-4264-9341-f39c55eafa0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b911090-a501-452a-a039-bb3a83c3055b", "name": "network-vif-unplugged", "status": "completed", "tag": "616eb23c-cba6-4708-a5fb-a61c3ccb7b2c"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:01.472138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-2117bd52-5a9a-4438-ac6a-67d571b89204 req-e92759e5-b771-4264-9341-f39c55eafa0a service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.472590 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-2117bd52-5a9a-4438-ac6a-67d571b89204 req-e92759e5-b771-4264-9341-f39c55eafa0a service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.484518 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.compute.server_external_events [req-2117bd52-5a9a-4438-ac6a-67d571b89204 req-e92759e5-b771-4264-9341-f39c55eafa0a service nova] Unable to find a host for instance 1b911090-a501-452a-a039-bb3a83c3055b. Dropping event network-vif-unplugged {{(pid=117020) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 18:19:01.485682 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-2117bd52-5a9a-4438-ac6a-67d571b89204 req-e92759e5-b771-4264-9341-f39c55eafa0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025528 May 17 18:19:01.486905 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 450/916] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 17 18:19:01.712922 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9d58f307-2a80-4e89-a19c-d3c8ab8dd768 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "POST /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.275844 May 17 18:19:01.713580 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 467/917] 10.222.0.25 () {62 vars in 1363 bytes} [Tue May 17 18:19:01 2022] POST /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/os-volume_attachments => generated 188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:19:01.823658 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-57f30be4-cbbc-4cc2-b71e-075d73ae6721 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:01.824151 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-57f30be4-cbbc-4cc2-b71e-075d73ae6721 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:01.829989 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57f30be4-cbbc-4cc2-b71e-075d73ae6721 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.830462 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57f30be4-cbbc-4cc2-b71e-075d73ae6721 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.831259 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57f30be4-cbbc-4cc2-b71e-075d73ae6721 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.831718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57f30be4-cbbc-4cc2-b71e-075d73ae6721 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:02.057577 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-57f30be4-cbbc-4cc2-b71e-075d73ae6721 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/os-volume_attachments/e3827fd7-55a8-413f-96b3-bb96ad5601b8" status: 202 len: 0 microversion: 2.20 time: 0.237684 May 17 18:19:02.058168 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 451/918] 10.222.0.25 () {60 vars in 1456 bytes} [Tue May 17 18:19:01 2022] DELETE /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/os-volume_attachments/e3827fd7-55a8-413f-96b3-bb96ad5601b8 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:19:02.113390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8f613232-d60f-4b82-9227-4dfbad84ca22 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:02.113967 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8f613232-d60f-4b82-9227-4dfbad84ca22 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:02.119844 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f613232-d60f-4b82-9227-4dfbad84ca22 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:02.120306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f613232-d60f-4b82-9227-4dfbad84ca22 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:02.121084 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f613232-d60f-4b82-9227-4dfbad84ca22 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:02.121531 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f613232-d60f-4b82-9227-4dfbad84ca22 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:02.215760 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8f613232-d60f-4b82-9227-4dfbad84ca22 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "POST /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/action" status: 202 len: 0 microversion: 2.20 time: 0.106688 May 17 18:19:02.216285 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 468/919] 10.222.0.25 () {62 vars in 1318 bytes} [Tue May 17 18:19:02 2022] POST /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:19:02.224794 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e58f6850-9341-4184-8a6c-96c0fd1d61a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:02.225398 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e58f6850-9341-4184-8a6c-96c0fd1d61a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:02.231265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e58f6850-9341-4184-8a6c-96c0fd1d61a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:02.231952 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e58f6850-9341-4184-8a6c-96c0fd1d61a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:02.232719 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e58f6850-9341-4184-8a6c-96c0fd1d61a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:02.233156 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e58f6850-9341-4184-8a6c-96c0fd1d61a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:02.378943 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e58f6850-9341-4184-8a6c-96c0fd1d61a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:02.388063 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e58f6850-9341-4184-8a6c-96c0fd1d61a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:02.390089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e58f6850-9341-4184-8a6c-96c0fd1d61a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:02.391478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e58f6850-9341-4184-8a6c-96c0fd1d61a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1673 microversion: 2.20 time: 0.171174 May 17 18:19:02.392026 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 452/920] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:02 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:03.411095 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4e9acf22-433c-477f-88a2-c4dcb4f6382b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:03.411837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4e9acf22-433c-477f-88a2-c4dcb4f6382b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:03.419697 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4e9acf22-433c-477f-88a2-c4dcb4f6382b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:03.420146 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4e9acf22-433c-477f-88a2-c4dcb4f6382b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:03.420918 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4e9acf22-433c-477f-88a2-c4dcb4f6382b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:03.421351 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4e9acf22-433c-477f-88a2-c4dcb4f6382b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:03.550819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4e9acf22-433c-477f-88a2-c4dcb4f6382b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:03.558561 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4e9acf22-433c-477f-88a2-c4dcb4f6382b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:03.560158 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-4e9acf22-433c-477f-88a2-c4dcb4f6382b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:03.561418 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4e9acf22-433c-477f-88a2-c4dcb4f6382b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.155050 May 17 18:19:03.562050 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 469/921] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:03 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:04.581551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d001cae2-4576-4900-aecb-e010161ed1ee tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:04.582187 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d001cae2-4576-4900-aecb-e010161ed1ee tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:04.588535 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d001cae2-4576-4900-aecb-e010161ed1ee tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:04.588983 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d001cae2-4576-4900-aecb-e010161ed1ee tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:04.589744 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d001cae2-4576-4900-aecb-e010161ed1ee tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:04.590181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d001cae2-4576-4900-aecb-e010161ed1ee tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:04.734511 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d001cae2-4576-4900-aecb-e010161ed1ee tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:04.743603 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d001cae2-4576-4900-aecb-e010161ed1ee tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:04.745510 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d001cae2-4576-4900-aecb-e010161ed1ee tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:04.747231 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d001cae2-4576-4900-aecb-e010161ed1ee tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.170011 May 17 18:19:04.768425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 453/922] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:04 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:05.774681 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-18128b78-3f29-4560-95fc-62f7152a16ce tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:05.775302 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-18128b78-3f29-4560-95fc-62f7152a16ce tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:05.781792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-18128b78-3f29-4560-95fc-62f7152a16ce tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:05.782289 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-18128b78-3f29-4560-95fc-62f7152a16ce tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:05.783747 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-18128b78-3f29-4560-95fc-62f7152a16ce tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:05.784298 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-18128b78-3f29-4560-95fc-62f7152a16ce tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:05.924280 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-18128b78-3f29-4560-95fc-62f7152a16ce tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:05.932364 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-18128b78-3f29-4560-95fc-62f7152a16ce tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:05.933861 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-18128b78-3f29-4560-95fc-62f7152a16ce tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:05.945387 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-18128b78-3f29-4560-95fc-62f7152a16ce tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.168017 May 17 18:19:05.946222 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 470/923] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:05 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:06.965680 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-74bc3d7a-b09c-476f-9fb3-6a5b160e6e0e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:06.967367 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-74bc3d7a-b09c-476f-9fb3-6a5b160e6e0e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:06.975852 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-74bc3d7a-b09c-476f-9fb3-6a5b160e6e0e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:06.976517 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-74bc3d7a-b09c-476f-9fb3-6a5b160e6e0e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:06.977294 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-74bc3d7a-b09c-476f-9fb3-6a5b160e6e0e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:06.977734 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-74bc3d7a-b09c-476f-9fb3-6a5b160e6e0e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:07.121516 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-74bc3d7a-b09c-476f-9fb3-6a5b160e6e0e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:07.130897 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-74bc3d7a-b09c-476f-9fb3-6a5b160e6e0e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:07.132784 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-74bc3d7a-b09c-476f-9fb3-6a5b160e6e0e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:07.134035 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-74bc3d7a-b09c-476f-9fb3-6a5b160e6e0e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.174084 May 17 18:19:07.134716 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 454/924] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:06 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:08.125619 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0f6eced0-8af0-4ba3-9e23-505cd05fe15f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:08.126171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0f6eced0-8af0-4ba3-9e23-505cd05fe15f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:08.133397 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0f6eced0-8af0-4ba3-9e23-505cd05fe15f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:08.134309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0f6eced0-8af0-4ba3-9e23-505cd05fe15f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:08.135144 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0f6eced0-8af0-4ba3-9e23-505cd05fe15f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:08.135581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0f6eced0-8af0-4ba3-9e23-505cd05fe15f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:08.152324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ccfac795-5096-4aa8-86d9-0bb877700d13 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:08.153342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ccfac795-5096-4aa8-86d9-0bb877700d13 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:08.160570 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ccfac795-5096-4aa8-86d9-0bb877700d13 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:08.161034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ccfac795-5096-4aa8-86d9-0bb877700d13 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:08.161876 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ccfac795-5096-4aa8-86d9-0bb877700d13 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:08.162502 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ccfac795-5096-4aa8-86d9-0bb877700d13 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:08.168753 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0f6eced0-8af0-4ba3-9e23-505cd05fe15f tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/ips" status: 200 len: 150 microversion: 2.1 time: 0.047174 May 17 18:19:08.169386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 471/925] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 17 18:19:08 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:19:08.306034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ccfac795-5096-4aa8-86d9-0bb877700d13 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:08.314929 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ccfac795-5096-4aa8-86d9-0bb877700d13 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:08.319380 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ccfac795-5096-4aa8-86d9-0bb877700d13 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:08.322085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ccfac795-5096-4aa8-86d9-0bb877700d13 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.173586 May 17 18:19:08.324955 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 455/926] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:08 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:19:09.345701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-636d7ab7-6c0f-493a-bf31-86ca7eb64a59 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:09.348062 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-636d7ab7-6c0f-493a-bf31-86ca7eb64a59 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:09.355957 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-636d7ab7-6c0f-493a-bf31-86ca7eb64a59 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:09.356422 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-636d7ab7-6c0f-493a-bf31-86ca7eb64a59 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.357405 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-636d7ab7-6c0f-493a-bf31-86ca7eb64a59 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:09.357849 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-636d7ab7-6c0f-493a-bf31-86ca7eb64a59 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.526916 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-636d7ab7-6c0f-493a-bf31-86ca7eb64a59 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:09.536184 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-636d7ab7-6c0f-493a-bf31-86ca7eb64a59 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:09.538207 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-636d7ab7-6c0f-493a-bf31-86ca7eb64a59 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:09.539616 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-636d7ab7-6c0f-493a-bf31-86ca7eb64a59 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.199457 May 17 18:19:09.540368 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 472/927] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:09 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:09.547143 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-711a2f3d-459b-41b3-8845-6510f16e029b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01290b52-795d-41a3-a08b-75afc00f7410"}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:09.548304 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-711a2f3d-459b-41b3-8845-6510f16e029b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:09.554710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-711a2f3d-459b-41b3-8845-6510f16e029b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:09.555167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-711a2f3d-459b-41b3-8845-6510f16e029b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.555941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-711a2f3d-459b-41b3-8845-6510f16e029b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:09.556376 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-711a2f3d-459b-41b3-8845-6510f16e029b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.754996 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1142483b-b8f7-4bfb-a068-de244054b323 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:09.755882 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1142483b-b8f7-4bfb-a068-de244054b323 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:09.764276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1142483b-b8f7-4bfb-a068-de244054b323 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:09.765107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1142483b-b8f7-4bfb-a068-de244054b323 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.766124 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1142483b-b8f7-4bfb-a068-de244054b323 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:09.766804 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1142483b-b8f7-4bfb-a068-de244054b323 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.796392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1142483b-b8f7-4bfb-a068-de244054b323 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/ips" status: 200 len: 146 microversion: 2.1 time: 0.045654 May 17 18:19:09.797235 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 473/928] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 17 18:19:09 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:10.562418 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-064ab6e2-7de7-4fa4-8bc3-b8f1848db3be tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:10.565200 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-064ab6e2-7de7-4fa4-8bc3-b8f1848db3be tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:10.573201 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-064ab6e2-7de7-4fa4-8bc3-b8f1848db3be tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:10.573660 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-064ab6e2-7de7-4fa4-8bc3-b8f1848db3be tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:10.574693 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-064ab6e2-7de7-4fa4-8bc3-b8f1848db3be tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:10.575139 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-064ab6e2-7de7-4fa4-8bc3-b8f1848db3be tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:10.739064 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-064ab6e2-7de7-4fa4-8bc3-b8f1848db3be tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:10.747897 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-064ab6e2-7de7-4fa4-8bc3-b8f1848db3be tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:10.749775 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-064ab6e2-7de7-4fa4-8bc3-b8f1848db3be tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:10.751281 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-064ab6e2-7de7-4fa4-8bc3-b8f1848db3be tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.196575 May 17 18:19:10.762517 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 474/929] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:10 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:19:11.163478 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c58fb38b-be5e-4d02-bba3-e6772145979a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f89a412-fe67-435f-91ac-e5d3674efeed"}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:11.164702 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c58fb38b-be5e-4d02-bba3-e6772145979a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:11.170964 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c58fb38b-be5e-4d02-bba3-e6772145979a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:11.171768 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c58fb38b-be5e-4d02-bba3-e6772145979a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:11.172782 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c58fb38b-be5e-4d02-bba3-e6772145979a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:11.173774 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c58fb38b-be5e-4d02-bba3-e6772145979a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:14.781481 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c58fb38b-be5e-4d02-bba3-e6772145979a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.622009 May 17 18:19:14.782208 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-711a2f3d-459b-41b3-8845-6510f16e029b tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "POST /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.238756 May 17 18:19:14.782741 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 475/930] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:19:11 2022] POST /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments => generated 194 bytes in 3625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:19:14.782918 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 456/931] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:19:09 2022] POST /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments => generated 194 bytes in 5240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:14.792747 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-58a6e092-5fe3-4457-b49a-1744606b92a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:14.793648 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-58a6e092-5fe3-4457-b49a-1744606b92a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:14.801371 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-58a6e092-5fe3-4457-b49a-1744606b92a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:14.801828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-58a6e092-5fe3-4457-b49a-1744606b92a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:14.802645 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-58a6e092-5fe3-4457-b49a-1744606b92a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:14.803092 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-58a6e092-5fe3-4457-b49a-1744606b92a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:14.940573 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-58a6e092-5fe3-4457-b49a-1744606b92a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:14.948596 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-58a6e092-5fe3-4457-b49a-1744606b92a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:14.950088 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-58a6e092-5fe3-4457-b49a-1744606b92a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:14.951277 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-58a6e092-5fe3-4457-b49a-1744606b92a3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.162636 May 17 18:19:14.951828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 476/932] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:14 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:15.970143 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-48fbfd63-7f54-4b40-8674-0ed76d09b841 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:15.970866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-48fbfd63-7f54-4b40-8674-0ed76d09b841 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:15.977035 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-48fbfd63-7f54-4b40-8674-0ed76d09b841 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:15.977489 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-48fbfd63-7f54-4b40-8674-0ed76d09b841 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:15.978251 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-48fbfd63-7f54-4b40-8674-0ed76d09b841 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:15.978714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-48fbfd63-7f54-4b40-8674-0ed76d09b841 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:16.111362 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-48fbfd63-7f54-4b40-8674-0ed76d09b841 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:16.119061 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-48fbfd63-7f54-4b40-8674-0ed76d09b841 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:16.120563 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-48fbfd63-7f54-4b40-8674-0ed76d09b841 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:16.121717 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-48fbfd63-7f54-4b40-8674-0ed76d09b841 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.156340 May 17 18:19:16.122272 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 457/933] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:15 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:17.140385 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-df302232-b4a3-4278-992a-2ba8a059598c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:17.140969 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-df302232-b4a3-4278-992a-2ba8a059598c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:17.147863 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df302232-b4a3-4278-992a-2ba8a059598c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:17.148342 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df302232-b4a3-4278-992a-2ba8a059598c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:17.149050 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df302232-b4a3-4278-992a-2ba8a059598c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:17.149482 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-df302232-b4a3-4278-992a-2ba8a059598c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:17.276498 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-df302232-b4a3-4278-992a-2ba8a059598c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:17.285092 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-df302232-b4a3-4278-992a-2ba8a059598c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:17.286818 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-df302232-b4a3-4278-992a-2ba8a059598c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:17.287984 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-df302232-b4a3-4278-992a-2ba8a059598c tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.151668 May 17 18:19:17.288536 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 477/934] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:17 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:18.305612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3f87f992-47c0-4f40-80ea-64777aaf14b6 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:18.306218 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3f87f992-47c0-4f40-80ea-64777aaf14b6 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:18.312764 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f87f992-47c0-4f40-80ea-64777aaf14b6 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:18.313228 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f87f992-47c0-4f40-80ea-64777aaf14b6 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:18.314069 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f87f992-47c0-4f40-80ea-64777aaf14b6 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:18.314621 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3f87f992-47c0-4f40-80ea-64777aaf14b6 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:18.456138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3f87f992-47c0-4f40-80ea-64777aaf14b6 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:18.466221 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3f87f992-47c0-4f40-80ea-64777aaf14b6 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:18.467762 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3f87f992-47c0-4f40-80ea-64777aaf14b6 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:18.469000 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3f87f992-47c0-4f40-80ea-64777aaf14b6 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.167475 May 17 18:19:18.469591 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 458/935] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:18 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:19.488308 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f529013d-2136-45f4-836e-a9d4dd161e2b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:19.488913 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f529013d-2136-45f4-836e-a9d4dd161e2b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:19.495212 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f529013d-2136-45f4-836e-a9d4dd161e2b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:19.495662 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f529013d-2136-45f4-836e-a9d4dd161e2b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:19.496454 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f529013d-2136-45f4-836e-a9d4dd161e2b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:19.496889 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f529013d-2136-45f4-836e-a9d4dd161e2b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:19.627364 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f529013d-2136-45f4-836e-a9d4dd161e2b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:19.635155 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f529013d-2136-45f4-836e-a9d4dd161e2b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:19.636685 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f529013d-2136-45f4-836e-a9d4dd161e2b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:19.637925 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f529013d-2136-45f4-836e-a9d4dd161e2b tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.154105 May 17 18:19:19.638419 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 478/936] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:19 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:20.655768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6d4f4a73-6a1e-4cd2-837d-fe7b205b7322 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:20.656324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6d4f4a73-6a1e-4cd2-837d-fe7b205b7322 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:20.663034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6d4f4a73-6a1e-4cd2-837d-fe7b205b7322 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:20.663492 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6d4f4a73-6a1e-4cd2-837d-fe7b205b7322 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:20.664268 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6d4f4a73-6a1e-4cd2-837d-fe7b205b7322 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:20.664714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6d4f4a73-6a1e-4cd2-837d-fe7b205b7322 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:20.791841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6d4f4a73-6a1e-4cd2-837d-fe7b205b7322 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:20.800471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6d4f4a73-6a1e-4cd2-837d-fe7b205b7322 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:20.801980 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6d4f4a73-6a1e-4cd2-837d-fe7b205b7322 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:20.803167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6d4f4a73-6a1e-4cd2-837d-fe7b205b7322 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.151361 May 17 18:19:20.803729 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 459/937] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:20 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:21.822323 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ab6b4b3e-244d-4fb2-892c-b662ea93ddff tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:21.822872 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ab6b4b3e-244d-4fb2-892c-b662ea93ddff tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:21.829693 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab6b4b3e-244d-4fb2-892c-b662ea93ddff tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:21.830174 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab6b4b3e-244d-4fb2-892c-b662ea93ddff tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:21.830969 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab6b4b3e-244d-4fb2-892c-b662ea93ddff tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:21.831420 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ab6b4b3e-244d-4fb2-892c-b662ea93ddff tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:21.965655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ab6b4b3e-244d-4fb2-892c-b662ea93ddff tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:21.973932 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ab6b4b3e-244d-4fb2-892c-b662ea93ddff tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:21.975437 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ab6b4b3e-244d-4fb2-892c-b662ea93ddff tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:21.976594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ab6b4b3e-244d-4fb2-892c-b662ea93ddff tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.158294 May 17 18:19:21.977150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 479/938] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:21 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:22.365005 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-c579ca9c-b021-482a-aa1d-706fb8be38ce req-0dfaca04-1412-43e6-ba51-9a06fd8857e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b911090-a501-452a-a039-bb3a83c3055b", "name": "network-vif-plugged", "status": "completed", "tag": "616eb23c-cba6-4708-a5fb-a61c3ccb7b2c"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:22.375262 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-c579ca9c-b021-482a-aa1d-706fb8be38ce req-0dfaca04-1412-43e6-ba51-9a06fd8857e9 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:22.375718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-c579ca9c-b021-482a-aa1d-706fb8be38ce req-0dfaca04-1412-43e6-ba51-9a06fd8857e9 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:22.387380 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-c579ca9c-b021-482a-aa1d-706fb8be38ce req-0dfaca04-1412-43e6-ba51-9a06fd8857e9 service nova] Creating event network-vif-plugged:616eb23c-cba6-4708-a5fb-a61c3ccb7b2c for instance 1b911090-a501-452a-a039-bb3a83c3055b on hv-cinder-84130 May 17 18:19:22.392324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-c579ca9c-b021-482a-aa1d-706fb8be38ce req-0dfaca04-1412-43e6-ba51-9a06fd8857e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031999 May 17 18:19:22.393077 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 460/939] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:22.995494 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-dd3fdfee-54c2-454f-b783-e806159c0925 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:22.996100 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-dd3fdfee-54c2-454f-b783-e806159c0925 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:23.002481 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dd3fdfee-54c2-454f-b783-e806159c0925 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:23.002992 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dd3fdfee-54c2-454f-b783-e806159c0925 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:23.003774 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dd3fdfee-54c2-454f-b783-e806159c0925 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:23.004219 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-dd3fdfee-54c2-454f-b783-e806159c0925 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:23.135195 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-dd3fdfee-54c2-454f-b783-e806159c0925 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:23.143581 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-dd3fdfee-54c2-454f-b783-e806159c0925 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:23.145083 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-dd3fdfee-54c2-454f-b783-e806159c0925 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:23.146234 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-dd3fdfee-54c2-454f-b783-e806159c0925 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.154665 May 17 18:19:23.146823 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 480/940] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:22 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:24.168976 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-73fb372e-dcdd-493f-bbc2-c80a7ea2809d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:24.169615 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-73fb372e-dcdd-493f-bbc2-c80a7ea2809d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:24.177393 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-73fb372e-dcdd-493f-bbc2-c80a7ea2809d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:24.177856 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-73fb372e-dcdd-493f-bbc2-c80a7ea2809d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:24.178671 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-73fb372e-dcdd-493f-bbc2-c80a7ea2809d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:24.179121 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-73fb372e-dcdd-493f-bbc2-c80a7ea2809d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:24.347267 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-73fb372e-dcdd-493f-bbc2-c80a7ea2809d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:24.358175 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-73fb372e-dcdd-493f-bbc2-c80a7ea2809d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:24.360048 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-73fb372e-dcdd-493f-bbc2-c80a7ea2809d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:24.363190 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-73fb372e-dcdd-493f-bbc2-c80a7ea2809d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1731 microversion: 2.20 time: 0.202735 May 17 18:19:24.364345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 461/941] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:24 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:25.383933 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6377ccfa-7a88-4f2f-ac37-f4e0f1ce146a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:25.384492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6377ccfa-7a88-4f2f-ac37-f4e0f1ce146a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:25.390978 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6377ccfa-7a88-4f2f-ac37-f4e0f1ce146a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:25.391432 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6377ccfa-7a88-4f2f-ac37-f4e0f1ce146a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:25.392210 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6377ccfa-7a88-4f2f-ac37-f4e0f1ce146a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:25.392647 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6377ccfa-7a88-4f2f-ac37-f4e0f1ce146a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:25.527272 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6377ccfa-7a88-4f2f-ac37-f4e0f1ce146a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:25.535533 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6377ccfa-7a88-4f2f-ac37-f4e0f1ce146a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:25.537037 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6377ccfa-7a88-4f2f-ac37-f4e0f1ce146a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:25.538198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6377ccfa-7a88-4f2f-ac37-f4e0f1ce146a tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1718 microversion: 2.20 time: 0.158258 May 17 18:19:25.538791 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 481/942] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:25 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:19:30.690242 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-96b6e04c-4668-4102-9258-a140b62fad96 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:30.691194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-96b6e04c-4668-4102-9258-a140b62fad96 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:30.697850 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-96b6e04c-4668-4102-9258-a140b62fad96 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:30.698302 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-96b6e04c-4668-4102-9258-a140b62fad96 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:30.699088 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-96b6e04c-4668-4102-9258-a140b62fad96 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:30.699523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-96b6e04c-4668-4102-9258-a140b62fad96 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:30.729211 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-96b6e04c-4668-4102-9258-a140b62fad96 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043429 May 17 18:19:30.729755 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 462/943] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:30 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:30.740930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-60f1dad5-59ac-4b63-8f88-c8a2c5503500 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:30.741428 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-60f1dad5-59ac-4b63-8f88-c8a2c5503500 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:30.747707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-60f1dad5-59ac-4b63-8f88-c8a2c5503500 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:30.748152 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-60f1dad5-59ac-4b63-8f88-c8a2c5503500 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:30.748910 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-60f1dad5-59ac-4b63-8f88-c8a2c5503500 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:30.749343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-60f1dad5-59ac-4b63-8f88-c8a2c5503500 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:30.777439 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-60f1dad5-59ac-4b63-8f88-c8a2c5503500 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments/0f89a412-fe67-435f-91ac-e5d3674efeed" status: 200 len: 194 microversion: 2.1 time: 0.040376 May 17 18:19:30.778043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 482/944] 10.222.0.25 () {58 vars in 1412 bytes} [Tue May 17 18:19:30 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments/0f89a412-fe67-435f-91ac-e5d3674efeed => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:32.082754 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-267c04f4-4b5e-43a7-bc68-fe342ddbe408 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "870c0d38-d51f-4acc-90e3-25edf5f4d535"}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:32.083817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-267c04f4-4b5e-43a7-bc68-fe342ddbe408 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:32.090033 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-267c04f4-4b5e-43a7-bc68-fe342ddbe408 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:32.090489 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-267c04f4-4b5e-43a7-bc68-fe342ddbe408 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:32.091283 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-267c04f4-4b5e-43a7-bc68-fe342ddbe408 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:32.091724 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-267c04f4-4b5e-43a7-bc68-fe342ddbe408 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:32.326597 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-267c04f4-4b5e-43a7-bc68-fe342ddbe408 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "POST /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247945 May 17 18:19:32.327205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 463/945] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 17 18:19:32 2022] POST /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:37.162930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-61e2d0dc-a24e-471a-8148-795d24dc9890 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:37.163533 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-61e2d0dc-a24e-471a-8148-795d24dc9890 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:37.170600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-61e2d0dc-a24e-471a-8148-795d24dc9890 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:37.170600 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-61e2d0dc-a24e-471a-8148-795d24dc9890 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:37.171115 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-61e2d0dc-a24e-471a-8148-795d24dc9890 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:37.171560 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-61e2d0dc-a24e-471a-8148-795d24dc9890 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:37.255332 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-61e2d0dc-a24e-471a-8148-795d24dc9890 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lazy-loading 'services' on Instance uuid 5f36d239-5a80-418e-9e5c-ace79af53f6e {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:19:37.324654 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-61e2d0dc-a24e-471a-8148-795d24dc9890 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments/01290b52-795d-41a3-a08b-75afc00f7410" status: 202 len: 0 microversion: 2.1 time: 0.165918 May 17 18:19:37.325345 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 483/946] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:19:37 2022] DELETE /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments/01290b52-795d-41a3-a08b-75afc00f7410 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:19:37.334712 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-15b9e49a-a11d-4f4d-a669-445f2978c20a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:37.335786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-15b9e49a-a11d-4f4d-a669-445f2978c20a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:37.342762 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-15b9e49a-a11d-4f4d-a669-445f2978c20a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:37.343249 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-15b9e49a-a11d-4f4d-a669-445f2978c20a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:37.343996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-15b9e49a-a11d-4f4d-a669-445f2978c20a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:37.344486 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-15b9e49a-a11d-4f4d-a669-445f2978c20a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:37.376170 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-15b9e49a-a11d-4f4d-a669-445f2978c20a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046007 May 17 18:19:37.377730 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 464/947] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:37 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:38.388982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e1d5d8cf-283f-4d4a-85e3-a61ab001d432 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:38.390038 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e1d5d8cf-283f-4d4a-85e3-a61ab001d432 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:38.396883 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e1d5d8cf-283f-4d4a-85e3-a61ab001d432 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:38.397340 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e1d5d8cf-283f-4d4a-85e3-a61ab001d432 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:38.398461 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e1d5d8cf-283f-4d4a-85e3-a61ab001d432 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:38.398613 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e1d5d8cf-283f-4d4a-85e3-a61ab001d432 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:38.430508 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e1d5d8cf-283f-4d4a-85e3-a61ab001d432 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 May 17 18:19:38.431093 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 484/948] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:38 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:39.442183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4f5680b9-58af-4f86-bf50-54d84b5f6384 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:39.443366 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4f5680b9-58af-4f86-bf50-54d84b5f6384 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:39.449858 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4f5680b9-58af-4f86-bf50-54d84b5f6384 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:39.450348 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4f5680b9-58af-4f86-bf50-54d84b5f6384 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:39.451156 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4f5680b9-58af-4f86-bf50-54d84b5f6384 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:39.451601 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4f5680b9-58af-4f86-bf50-54d84b5f6384 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:39.484782 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4f5680b9-58af-4f86-bf50-54d84b5f6384 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046489 May 17 18:19:39.485388 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 465/949] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:39 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:40.495845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-2536f273-5ac3-4a0a-9bb3-cd855299b419 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:40.496814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-2536f273-5ac3-4a0a-9bb3-cd855299b419 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:40.503685 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2536f273-5ac3-4a0a-9bb3-cd855299b419 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:40.504133 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2536f273-5ac3-4a0a-9bb3-cd855299b419 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:40.504899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2536f273-5ac3-4a0a-9bb3-cd855299b419 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:40.505331 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2536f273-5ac3-4a0a-9bb3-cd855299b419 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:40.535106 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-2536f273-5ac3-4a0a-9bb3-cd855299b419 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 May 17 18:19:40.535668 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 485/950] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:40 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:41.546549 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-781ae196-5297-4940-864c-19c9fad9da74 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:41.548213 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-781ae196-5297-4940-864c-19c9fad9da74 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:41.556478 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-781ae196-5297-4940-864c-19c9fad9da74 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:41.556938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-781ae196-5297-4940-864c-19c9fad9da74 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:41.557698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-781ae196-5297-4940-864c-19c9fad9da74 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:41.558134 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-781ae196-5297-4940-864c-19c9fad9da74 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:41.749593 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-781ae196-5297-4940-864c-19c9fad9da74 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206991 May 17 18:19:41.750148 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 466/951] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:41 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:42.761334 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7e5ffadd-626f-4962-b939-98b1944e80bf tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:42.762379 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7e5ffadd-626f-4962-b939-98b1944e80bf tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:42.769362 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7e5ffadd-626f-4962-b939-98b1944e80bf tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:42.769816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7e5ffadd-626f-4962-b939-98b1944e80bf tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:42.770617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7e5ffadd-626f-4962-b939-98b1944e80bf tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:42.771063 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7e5ffadd-626f-4962-b939-98b1944e80bf tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:42.802208 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7e5ffadd-626f-4962-b939-98b1944e80bf tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 May 17 18:19:42.803082 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 486/952] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:42 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:42.965774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0f5c2f30-67e3-4842-b0fe-0d4a3d142ddc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:42.966731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0f5c2f30-67e3-4842-b0fe-0d4a3d142ddc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:42.973232 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0f5c2f30-67e3-4842-b0fe-0d4a3d142ddc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:42.973698 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0f5c2f30-67e3-4842-b0fe-0d4a3d142ddc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:42.974476 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0f5c2f30-67e3-4842-b0fe-0d4a3d142ddc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:42.974955 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0f5c2f30-67e3-4842-b0fe-0d4a3d142ddc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.013154 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0f5c2f30-67e3-4842-b0fe-0d4a3d142ddc tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051173 May 17 18:19:43.013711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 467/953] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:42 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:43.151791 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ae20e7c5-e498-49a3-af60-9c000457cee1 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:43.152590 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ae20e7c5-e498-49a3-af60-9c000457cee1 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:43.159935 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ae20e7c5-e498-49a3-af60-9c000457cee1 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:43.160556 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ae20e7c5-e498-49a3-af60-9c000457cee1 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.161404 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ae20e7c5-e498-49a3-af60-9c000457cee1 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:43.161951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ae20e7c5-e498-49a3-af60-9c000457cee1 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.193669 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ae20e7c5-e498-49a3-af60-9c000457cee1 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments/0f89a412-fe67-435f-91ac-e5d3674efeed" status: 200 len: 194 microversion: 2.1 time: 0.046574 May 17 18:19:43.194283 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 487/954] 10.222.0.25 () {58 vars in 1412 bytes} [Tue May 17 18:19:43 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments/0f89a412-fe67-435f-91ac-e5d3674efeed => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:43.204164 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4566d1c8-8606-4991-82e8-397776148267 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:43.204659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4566d1c8-8606-4991-82e8-397776148267 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:43.210872 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4566d1c8-8606-4991-82e8-397776148267 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:43.211324 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4566d1c8-8606-4991-82e8-397776148267 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.212108 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4566d1c8-8606-4991-82e8-397776148267 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:43.212550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4566d1c8-8606-4991-82e8-397776148267 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.297992 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-4566d1c8-8606-4991-82e8-397776148267 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lazy-loading 'services' on Instance uuid ee1d264e-2d3a-4a16-9a14-1c7d756c620c {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:19:43.373916 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4566d1c8-8606-4991-82e8-397776148267 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments/0f89a412-fe67-435f-91ac-e5d3674efeed" status: 202 len: 0 microversion: 2.1 time: 0.173826 May 17 18:19:43.374724 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 468/955] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:19:43 2022] DELETE /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments/0f89a412-fe67-435f-91ac-e5d3674efeed => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:19:43.813730 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c292c784-9b30-45a8-a3e1-70838e799765 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:43.818413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c292c784-9b30-45a8-a3e1-70838e799765 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:43.831199 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c292c784-9b30-45a8-a3e1-70838e799765 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:43.832619 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c292c784-9b30-45a8-a3e1-70838e799765 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.833787 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c292c784-9b30-45a8-a3e1-70838e799765 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:43.834390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c292c784-9b30-45a8-a3e1-70838e799765 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.868842 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c292c784-9b30-45a8-a3e1-70838e799765 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059235 May 17 18:19:43.869530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 488/956] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:43 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:19:43.929888 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1ea38a8c-70f2-4a81-96d9-9451de80da42 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:43.930685 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1ea38a8c-70f2-4a81-96d9-9451de80da42 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:43.937412 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1ea38a8c-70f2-4a81-96d9-9451de80da42 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:43.937866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1ea38a8c-70f2-4a81-96d9-9451de80da42 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.938672 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1ea38a8c-70f2-4a81-96d9-9451de80da42 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:43.939114 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1ea38a8c-70f2-4a81-96d9-9451de80da42 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.966260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1ea38a8c-70f2-4a81-96d9-9451de80da42 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Going to try to terminate instance {{(pid=117020) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:19:44.042296 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1ea38a8c-70f2-4a81-96d9-9451de80da42 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 204 len: 0 microversion: 2.1 time: 0.117590 May 17 18:19:44.043079 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 469/957] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:19:43 2022] DELETE /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:19:44.051839 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f8d7d1dd-0f41-46e3-b85d-17805812d372 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:44.052445 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f8d7d1dd-0f41-46e3-b85d-17805812d372 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:44.058402 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f8d7d1dd-0f41-46e3-b85d-17805812d372 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:44.058897 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f8d7d1dd-0f41-46e3-b85d-17805812d372 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:44.059659 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f8d7d1dd-0f41-46e3-b85d-17805812d372 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:44.060091 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f8d7d1dd-0f41-46e3-b85d-17805812d372 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:44.209651 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f8d7d1dd-0f41-46e3-b85d-17805812d372 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:44.217022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f8d7d1dd-0f41-46e3-b85d-17805812d372 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1682 microversion: 2.1 time: 0.169888 May 17 18:19:44.217579 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 489/958] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:44 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:45.233815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-67d4faf9-d101-4b60-a100-2c1d8bfe4da8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:45.234533 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-67d4faf9-d101-4b60-a100-2c1d8bfe4da8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:45.240888 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67d4faf9-d101-4b60-a100-2c1d8bfe4da8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:45.241345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67d4faf9-d101-4b60-a100-2c1d8bfe4da8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:45.242121 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67d4faf9-d101-4b60-a100-2c1d8bfe4da8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:45.242766 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-67d4faf9-d101-4b60-a100-2c1d8bfe4da8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:45.381670 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-67d4faf9-d101-4b60-a100-2c1d8bfe4da8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:45.389307 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-67d4faf9-d101-4b60-a100-2c1d8bfe4da8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1682 microversion: 2.1 time: 0.159785 May 17 18:19:45.389864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 470/959] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:45 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:46.407013 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8f67dc95-b82d-4582-bfb5-1820b77b4752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:46.408291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8f67dc95-b82d-4582-bfb5-1820b77b4752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:46.416577 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f67dc95-b82d-4582-bfb5-1820b77b4752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:46.417230 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f67dc95-b82d-4582-bfb5-1820b77b4752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:46.418028 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f67dc95-b82d-4582-bfb5-1820b77b4752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:46.418471 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f67dc95-b82d-4582-bfb5-1820b77b4752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:46.560688 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8f67dc95-b82d-4582-bfb5-1820b77b4752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:46.569863 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8f67dc95-b82d-4582-bfb5-1820b77b4752 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1682 microversion: 2.1 time: 0.167019 May 17 18:19:46.571216 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 490/960] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:46 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:46.598331 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0cba7910-465a-4560-a5ae-ee2471a854f5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:46.598905 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0cba7910-465a-4560-a5ae-ee2471a854f5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:46.605247 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0cba7910-465a-4560-a5ae-ee2471a854f5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:46.605700 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0cba7910-465a-4560-a5ae-ee2471a854f5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:46.606473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0cba7910-465a-4560-a5ae-ee2471a854f5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:46.606949 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0cba7910-465a-4560-a5ae-ee2471a854f5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:46.637503 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0cba7910-465a-4560-a5ae-ee2471a854f5 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments/870c0d38-d51f-4acc-90e3-25edf5f4d535" status: 200 len: 194 microversion: 2.1 time: 0.043011 May 17 18:19:46.638088 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 471/961] 10.222.0.25 () {58 vars in 1412 bytes} [Tue May 17 18:19:46 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments/870c0d38-d51f-4acc-90e3-25edf5f4d535 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:46.649313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-331ca5c4-a7e2-4eaa-b14c-b4b892078631 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:46.650595 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-331ca5c4-a7e2-4eaa-b14c-b4b892078631 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:46.656701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-331ca5c4-a7e2-4eaa-b14c-b4b892078631 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:46.657281 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-331ca5c4-a7e2-4eaa-b14c-b4b892078631 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:46.658114 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-331ca5c4-a7e2-4eaa-b14c-b4b892078631 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:46.658559 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-331ca5c4-a7e2-4eaa-b14c-b4b892078631 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:46.740887 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-331ca5c4-a7e2-4eaa-b14c-b4b892078631 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lazy-loading 'services' on Instance uuid ee1d264e-2d3a-4a16-9a14-1c7d756c620c {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:19:46.814012 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-331ca5c4-a7e2-4eaa-b14c-b4b892078631 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments/870c0d38-d51f-4acc-90e3-25edf5f4d535" status: 202 len: 0 microversion: 2.1 time: 0.169703 May 17 18:19:46.814816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 491/962] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 17 18:19:46 2022] DELETE /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments/870c0d38-d51f-4acc-90e3-25edf5f4d535 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:19:47.148523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-a3766c68-4d48-4752-9f1e-90d8ff75cf30 req-2454bf88-4465-466b-b690-9e8dcd4a43cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f36d239-5a80-418e-9e5c-ace79af53f6e", "name": "network-vif-deleted", "tag": "6f151f25-60f1-4b8c-87db-feea63856248"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:47.157554 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-a3766c68-4d48-4752-9f1e-90d8ff75cf30 req-2454bf88-4465-466b-b690-9e8dcd4a43cf service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:47.158402 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-a3766c68-4d48-4752-9f1e-90d8ff75cf30 req-2454bf88-4465-466b-b690-9e8dcd4a43cf service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:47.171787 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-a3766c68-4d48-4752-9f1e-90d8ff75cf30 req-2454bf88-4465-466b-b690-9e8dcd4a43cf service nova] Creating event network-vif-deleted:6f151f25-60f1-4b8c-87db-feea63856248 for instance 5f36d239-5a80-418e-9e5c-ace79af53f6e on hv-cinder-84130 May 17 18:19:47.179882 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-a3766c68-4d48-4752-9f1e-90d8ff75cf30 req-2454bf88-4465-466b-b690-9e8dcd4a43cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035032 May 17 18:19:47.180947 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 472/963] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:47.588734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:47.590033 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:47.600088 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:47.600824 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:47.602430 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:47.603118 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:47.642409 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:47.643350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:47.644218 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lazy-loading 'fault' on Instance uuid 5f36d239-5a80-418e-9e5c-ace79af53f6e {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:19:47.693166 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b641ce301a4b7685f0f70d7ac4a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ac01e59d43438b45bc5fc01fb00b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:47.700888 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3d5e85ee-b222-4f3a-af11-acf4a5e82055 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 200 len: 1331 microversion: 2.1 time: 0.117026 May 17 18:19:47.701690 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 492/964] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:47 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:47.983649 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-af804374-656a-4120-9de1-3f82752d9e7d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:47.984746 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-af804374-656a-4120-9de1-3f82752d9e7d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:47.991497 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-af804374-656a-4120-9de1-3f82752d9e7d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:47.992006 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-af804374-656a-4120-9de1-3f82752d9e7d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:47.992909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-af804374-656a-4120-9de1-3f82752d9e7d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:47.993447 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-af804374-656a-4120-9de1-3f82752d9e7d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:48.026951 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-af804374-656a-4120-9de1-3f82752d9e7d tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048281 May 17 18:19:48.027514 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 473/965] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:47 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:19:48.140886 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-4a07450d-cb69-4d50-a6cd-77269179dce4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:48.141935 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-4a07450d-cb69-4d50-a6cd-77269179dce4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:48.149044 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4a07450d-cb69-4d50-a6cd-77269179dce4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:48.149578 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4a07450d-cb69-4d50-a6cd-77269179dce4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:48.150394 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4a07450d-cb69-4d50-a6cd-77269179dce4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:48.150986 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-4a07450d-cb69-4d50-a6cd-77269179dce4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:48.186978 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-4a07450d-cb69-4d50-a6cd-77269179dce4 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049807 May 17 18:19:48.187567 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 493/966] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 17 18:19:48 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:19:48.246520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5f57b6f9-14a4-4e88-8ea4-c6c7b7192f8a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:48.247044 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5f57b6f9-14a4-4e88-8ea4-c6c7b7192f8a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:48.253067 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5f57b6f9-14a4-4e88-8ea4-c6c7b7192f8a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:48.253554 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5f57b6f9-14a4-4e88-8ea4-c6c7b7192f8a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:48.254322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5f57b6f9-14a4-4e88-8ea4-c6c7b7192f8a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:48.254814 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5f57b6f9-14a4-4e88-8ea4-c6c7b7192f8a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:48.280917 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5f57b6f9-14a4-4e88-8ea4-c6c7b7192f8a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Going to try to terminate instance {{(pid=117020) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:19:48.361326 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5f57b6f9-14a4-4e88-8ea4-c6c7b7192f8a tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 204 len: 0 microversion: 2.1 time: 0.118348 May 17 18:19:48.361924 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 474/967] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:19:48 2022] DELETE /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:19:48.371034 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9a620469-2d81-440e-8e6f-9056131772c8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:48.371735 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9a620469-2d81-440e-8e6f-9056131772c8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:48.377607 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9a620469-2d81-440e-8e6f-9056131772c8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:48.378069 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9a620469-2d81-440e-8e6f-9056131772c8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:48.378926 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9a620469-2d81-440e-8e6f-9056131772c8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:48.379381 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9a620469-2d81-440e-8e6f-9056131772c8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:48.505074 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9a620469-2d81-440e-8e6f-9056131772c8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:48.512403 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9a620469-2d81-440e-8e6f-9056131772c8 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1674 microversion: 2.1 time: 0.145269 May 17 18:19:48.512965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 494/968] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:48 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:48.718646 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2396214a-7169-4ce2-a874-2e3dc858a303 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:48.720157 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2396214a-7169-4ce2-a874-2e3dc858a303 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:48.726237 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2396214a-7169-4ce2-a874-2e3dc858a303 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:48.726731 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2396214a-7169-4ce2-a874-2e3dc858a303 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:48.727536 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2396214a-7169-4ce2-a874-2e3dc858a303 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:48.727976 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2396214a-7169-4ce2-a874-2e3dc858a303 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:48.741009 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-2396214a-7169-4ce2-a874-2e3dc858a303 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2396214a-7169-4ce2-a874-2e3dc858a303 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e HTTP/1.1 May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:19:48.742641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:48.744350 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '5f36d239-5a80-418e-9e5c-ace79af53f6e'} May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:48.745374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:48.747027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:48.748552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2396214a-7169-4ce2-a874-2e3dc858a303 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:48.748552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2396214a-7169-4ce2-a874-2e3dc858a303 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 404 len: 111 microversion: 2.1 time: 0.029606 May 17 18:19:48.748552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 475/969] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:48 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:48.752947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6aeeeb57-71bd-4b87-b8e9-fb877d9d2b9c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '.version_select at 0x7f74ab63aaf0>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:48.770592 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6aeeeb57-71bd-4b87-b8e9-fb877d9d2b9c tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722135440" status: 202 len: 0 microversion: 2.1 time: 0.021412 May 17 18:19:48.771142 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 495/970] 10.222.0.25 () {58 vars in 1217 bytes} [Tue May 17 18:19:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722135440 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:19:49.529569 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-942d2a5a-6925-4f64-b583-6483d9e0114c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:49.530174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-942d2a5a-6925-4f64-b583-6483d9e0114c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:49.537721 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-942d2a5a-6925-4f64-b583-6483d9e0114c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:49.538271 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-942d2a5a-6925-4f64-b583-6483d9e0114c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:49.539179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-942d2a5a-6925-4f64-b583-6483d9e0114c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:49.539622 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-942d2a5a-6925-4f64-b583-6483d9e0114c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:49.672885 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-942d2a5a-6925-4f64-b583-6483d9e0114c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:49.681796 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-942d2a5a-6925-4f64-b583-6483d9e0114c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1674 microversion: 2.1 time: 0.156051 May 17 18:19:49.682372 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 476/971] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:49 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:50.546264 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f672dcdf-889e-4b1b-99e2-cd72c618acf4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:50.546823 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f672dcdf-889e-4b1b-99e2-cd72c618acf4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:50.554361 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f672dcdf-889e-4b1b-99e2-cd72c618acf4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:50.554854 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f672dcdf-889e-4b1b-99e2-cd72c618acf4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:50.555638 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f672dcdf-889e-4b1b-99e2-cd72c618acf4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:50.556230 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f672dcdf-889e-4b1b-99e2-cd72c618acf4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:50.570268 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-f672dcdf-889e-4b1b-99e2-cd72c618acf4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f672dcdf-889e-4b1b-99e2-cd72c618acf4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: DELETE /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e HTTP/1.1 May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:19:50.572014 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:50.573689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '5f36d239-5a80-418e-9e5c-ace79af53f6e'} May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:50.577624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:50.579190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:50.580701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f672dcdf-889e-4b1b-99e2-cd72c618acf4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:50.580701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f672dcdf-889e-4b1b-99e2-cd72c618acf4 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 404 len: 111 microversion: 2.1 time: 0.031438 May 17 18:19:50.580701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 496/972] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:19:50 2022] DELETE /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:50.582743 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9039690c-b1e7-485c-98f6-c66d6388a1bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:50.583361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9039690c-b1e7-485c-98f6-c66d6388a1bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 5f36d239-5a80-418e-9e5c-ace79af53f6e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:50.589743 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9039690c-b1e7-485c-98f6-c66d6388a1bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:50.590417 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9039690c-b1e7-485c-98f6-c66d6388a1bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:50.591215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9039690c-b1e7-485c-98f6-c66d6388a1bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:50.591808 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9039690c-b1e7-485c-98f6-c66d6388a1bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:50.606046 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-9039690c-b1e7-485c-98f6-c66d6388a1bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9039690c-b1e7-485c-98f6-c66d6388a1bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e HTTP/1.1 May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:19:50.607745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:50.609361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '5f36d239-5a80-418e-9e5c-ace79af53f6e'} May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:50.610176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. May 17 18:19:50.611551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:50.613284 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9039690c-b1e7-485c-98f6-c66d6388a1bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 5f36d239-5a80-418e-9e5c-ace79af53f6e could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:50.613284 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9039690c-b1e7-485c-98f6-c66d6388a1bb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e" status: 404 len: 111 microversion: 2.1 time: 0.031181 May 17 18:19:50.613284 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 477/973] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:50 2022] GET /compute/v2.1/servers/5f36d239-5a80-418e-9e5c-ace79af53f6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:50.701330 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-42423ce2-39d6-4670-8f90-fb66044c63c9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:50.702076 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-42423ce2-39d6-4670-8f90-fb66044c63c9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:50.719483 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-42423ce2-39d6-4670-8f90-fb66044c63c9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:50.720226 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-42423ce2-39d6-4670-8f90-fb66044c63c9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:50.721276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-42423ce2-39d6-4670-8f90-fb66044c63c9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:50.722147 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-42423ce2-39d6-4670-8f90-fb66044c63c9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:50.921664 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-42423ce2-39d6-4670-8f90-fb66044c63c9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17c2097983df461eb7c23bc0ed7b7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c087a662f09843faa87b942c9462ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:50.936723 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-42423ce2-39d6-4670-8f90-fb66044c63c9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 200 len: 1674 microversion: 2.1 time: 0.239215 May 17 18:19:50.937309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 497/974] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:50 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 1674 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:51.254318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-376e8084-649b-460f-9b85-771dfac4a145 req-c8ab993e-ba07-4a7c-8715-cfa8920ca272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1d264e-2d3a-4a16-9a14-1c7d756c620c", "name": "network-vif-deleted", "tag": "c0c0c04b-f7a7-40fc-80b8-5514db09a6c9"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:51.263711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-376e8084-649b-460f-9b85-771dfac4a145 req-c8ab993e-ba07-4a7c-8715-cfa8920ca272 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.264298 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-376e8084-649b-460f-9b85-771dfac4a145 req-c8ab993e-ba07-4a7c-8715-cfa8920ca272 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.280529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-376e8084-649b-460f-9b85-771dfac4a145 req-c8ab993e-ba07-4a7c-8715-cfa8920ca272 service nova] Creating event network-vif-deleted:c0c0c04b-f7a7-40fc-80b8-5514db09a6c9 for instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c on hv-cinder-84130 May 17 18:19:51.296506 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-376e8084-649b-460f-9b85-771dfac4a145 req-c8ab993e-ba07-4a7c-8715-cfa8920ca272 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045731 May 17 18:19:51.297247 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 478/975] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:19:51.756583 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8a7cf226-df0b-4f91-b3a5-de255ef723e8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:51.757218 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8a7cf226-df0b-4f91-b3a5-de255ef723e8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:51.770813 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a7cf226-df0b-4f91-b3a5-de255ef723e8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.771707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a7cf226-df0b-4f91-b3a5-de255ef723e8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.772603 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a7cf226-df0b-4f91-b3a5-de255ef723e8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.773149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8a7cf226-df0b-4f91-b3a5-de255ef723e8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.794885 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-8a7cf226-df0b-4f91-b3a5-de255ef723e8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8a7cf226-df0b-4f91-b3a5-de255ef723e8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: DELETE /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b HTTP/1.1 May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:19:51.804011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:19:51.805728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '7e4705dd-6079-47f8-9525-79f5ae7b678b'} May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:51.806712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:19:51.808171 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.810103 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8a7cf226-df0b-4f91-b3a5-de255ef723e8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:51.812448 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8a7cf226-df0b-4f91-b3a5-de255ef723e8 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 404 len: 111 microversion: 2.1 time: 0.059640 May 17 18:19:51.819430 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 498/976] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:19:51 2022] DELETE /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:51.823176 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9ff9dda7-cc5f-4ccc-bb4c-ae723407c6b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:51.823995 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9ff9dda7-cc5f-4ccc-bb4c-ae723407c6b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 7e4705dd-6079-47f8-9525-79f5ae7b678b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:51.831028 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ff9dda7-cc5f-4ccc-bb4c-ae723407c6b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.831591 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ff9dda7-cc5f-4ccc-bb4c-ae723407c6b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.832409 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ff9dda7-cc5f-4ccc-bb4c-ae723407c6b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.832845 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9ff9dda7-cc5f-4ccc-bb4c-ae723407c6b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.847646 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-9ff9dda7-cc5f-4ccc-bb4c-ae723407c6b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9ff9dda7-cc5f-4ccc-bb4c-ae723407c6b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b HTTP/1.1 May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:19:51.849461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:19:51.851102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '7e4705dd-6079-47f8-9525-79f5ae7b678b'} May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:51.855202 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. May 17 18:19:51.856674 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:51.857969 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9ff9dda7-cc5f-4ccc-bb4c-ae723407c6b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 7e4705dd-6079-47f8-9525-79f5ae7b678b could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:51.857969 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9ff9dda7-cc5f-4ccc-bb4c-ae723407c6b3 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b" status: 404 len: 111 microversion: 2.1 time: 0.031950 May 17 18:19:51.857969 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 479/977] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:51 2022] GET /compute/v2.1/servers/7e4705dd-6079-47f8-9525-79f5ae7b678b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:51.863901 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5f6a01f8-a4e0-4e8b-a644-2c59c151c88a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:51.864570 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5f6a01f8-a4e0-4e8b-a644-2c59c151c88a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:51.871020 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f6a01f8-a4e0-4e8b-a644-2c59c151c88a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.871626 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f6a01f8-a4e0-4e8b-a644-2c59c151c88a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.872546 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f6a01f8-a4e0-4e8b-a644-2c59c151c88a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.873211 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f6a01f8-a4e0-4e8b-a644-2c59c151c88a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.891857 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-5f6a01f8-a4e0-4e8b-a644-2c59c151c88a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5f6a01f8-a4e0-4e8b-a644-2c59c151c88a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: DELETE /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 HTTP/1.1 May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:19:51.893293 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:19:51.894899 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '1a6933d9-d646-4718-9297-741290e08790'} May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:51.895714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:19:51.896947 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.899076 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5f6a01f8-a4e0-4e8b-a644-2c59c151c88a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:51.899076 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5f6a01f8-a4e0-4e8b-a644-2c59c151c88a tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 404 len: 111 microversion: 2.1 time: 0.035864 May 17 18:19:51.899076 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 499/978] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:19:51 2022] DELETE /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:51.903342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-88e5084d-7c02-489c-8d33-049d81a118c5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:51.904321 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-88e5084d-7c02-489c-8d33-049d81a118c5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a6933d9-d646-4718-9297-741290e08790] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:51.911361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-88e5084d-7c02-489c-8d33-049d81a118c5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.911990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-88e5084d-7c02-489c-8d33-049d81a118c5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.912935 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-88e5084d-7c02-489c-8d33-049d81a118c5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.913422 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-88e5084d-7c02-489c-8d33-049d81a118c5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.928183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-88e5084d-7c02-489c-8d33-049d81a118c5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-88e5084d-7c02-489c-8d33-049d81a118c5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 HTTP/1.1 May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:19:51.929714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:19:51.931260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '1a6933d9-d646-4718-9297-741290e08790'} May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:51.932225 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. May 17 18:19:51.933542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:51.934789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-88e5084d-7c02-489c-8d33-049d81a118c5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 1a6933d9-d646-4718-9297-741290e08790 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:51.934789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-88e5084d-7c02-489c-8d33-049d81a118c5 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790" status: 404 len: 111 microversion: 2.1 time: 0.031874 May 17 18:19:51.934789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 480/979] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:51 2022] GET /compute/v2.1/servers/1a6933d9-d646-4718-9297-741290e08790 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 18:19:51.955385 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b4babcde-5c4f-44aa-b3f2-d5f609132f78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:51.955950 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b4babcde-5c4f-44aa-b3f2-d5f609132f78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:51.962101 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b4babcde-5c4f-44aa-b3f2-d5f609132f78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.962638 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b4babcde-5c4f-44aa-b3f2-d5f609132f78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.963656 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b4babcde-5c4f-44aa-b3f2-d5f609132f78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.964257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b4babcde-5c4f-44aa-b3f2-d5f609132f78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.980909 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-b4babcde-5c4f-44aa-b3f2-d5f609132f78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] HTTP exception thrown: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b4babcde-5c4f-44aa-b3f2-d5f609132f78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Request method failure captured: May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c HTTP/1.1 May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WwrK1zhQPlNa0O5rU9u5rx4UpWlmG6bI1E4WoakKVpT4nD2EzSnM0QqKXRSQyYhmXL5BYVE6TSYETf2FtlhukT27kePUlnRi8fVmocTgsQhii7m58J-RKq3pLrRvfH2i_eNNCvHH4YoevVmaK4XhJQ5rqhXziWDPIYxutWIlyHPME May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: c087a662f09843faa87b942c9462ec67 May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:19:51.982598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c087a662f09843faa87b942c9462ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c087a662f09843faa87b942c9462ec67", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: c087a662f09843faa87b942c9462ec67 May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 17c2097983df461eb7c23bc0ed7b7520 May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:51.984386 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': 'ee1d264e-2d3a-4a16-9a14-1c7d756c620c'} May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:51.988789 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:51.990444 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:51.991806 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b4babcde-5c4f-44aa-b3f2-d5f609132f78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Returning 404 to user: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:51.991806 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b4babcde-5c4f-44aa-b3f2-d5f609132f78 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 404 len: 111 microversion: 2.1 time: 0.033097 May 17 18:19:51.991806 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 500/980] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:51 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:51.995277 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-678debf9-6a9f-490f-a0d6-b340614dfce9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '.version_select at 0x7f74abfc39d0>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:52.023190 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-678debf9-6a9f-490f-a0d6-b340614dfce9 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229460090" status: 202 len: 0 microversion: 2.1 time: 0.031928 May 17 18:19:52.024137 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 481/981] 10.222.0.25 () {58 vars in 1220 bytes} [Tue May 17 18:19:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229460090 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:19:53.116240 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fb04fd29-7233-472d-9b68-24ed9099f3eb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:53.116745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-fb04fd29-7233-472d-9b68-24ed9099f3eb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:53.123026 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fb04fd29-7233-472d-9b68-24ed9099f3eb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:53.123469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fb04fd29-7233-472d-9b68-24ed9099f3eb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:53.124231 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fb04fd29-7233-472d-9b68-24ed9099f3eb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:53.124664 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fb04fd29-7233-472d-9b68-24ed9099f3eb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:53.138282 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-fb04fd29-7233-472d-9b68-24ed9099f3eb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fb04fd29-7233-472d-9b68-24ed9099f3eb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: DELETE /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 HTTP/1.1 May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:19:53.139831 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:19:53.141525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '1a4f1963-1182-4b7f-8347-100ee3382934'} May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:53.142324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:19:53.143663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:53.145843 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fb04fd29-7233-472d-9b68-24ed9099f3eb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:53.145843 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-fb04fd29-7233-472d-9b68-24ed9099f3eb tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 404 len: 111 microversion: 2.1 time: 0.029324 May 17 18:19:53.145843 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 501/982] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:19:53 2022] DELETE /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:53.149340 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e532f6ee-6682-4b1c-8344-c1dbbfe12e07 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:53.150019 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e532f6ee-6682-4b1c-8344-c1dbbfe12e07 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] [instance: 1a4f1963-1182-4b7f-8347-100ee3382934] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:53.159904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e532f6ee-6682-4b1c-8344-c1dbbfe12e07 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:53.160158 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e532f6ee-6682-4b1c-8344-c1dbbfe12e07 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:53.160938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e532f6ee-6682-4b1c-8344-c1dbbfe12e07 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:53.161359 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e532f6ee-6682-4b1c-8344-c1dbbfe12e07 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:53.173947 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-e532f6ee-6682-4b1c-8344-c1dbbfe12e07 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] HTTP exception thrown: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e532f6ee-6682-4b1c-8344-c1dbbfe12e07 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Request method failure captured: May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 HTTP/1.1 May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WjLVjuikccf4b9GRpysIZ28r3HW9Pn9EkO7D1tLkmFOSdpnpYB01n9bbq6tcoCkGuDLE-ilDZ3CAPfKi5NxKpfs6AmiZjbrF--WDORvYY5zCPNNhqC3R_O-U1dWkXtdjZ1UCnFCc_34wApUObuY8W4ukw902UzePbCq21z22og8u4 May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:19:53.176089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4475ac01e59d43438b45bc5fc01fb00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4475ac01e59d43438b45bc5fc01fb00b", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 4475ac01e59d43438b45bc5fc01fb00b May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1772091373 May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: c7b641ce301a4b7685f0f70d7ac4a5d3 May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeNegativeTest-1772091373-project May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:19:53.177710 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '1a4f1963-1182-4b7f-8347-100ee3382934'} May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:53.178607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. May 17 18:19:53.179908 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:53.181023 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e532f6ee-6682-4b1c-8344-c1dbbfe12e07 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] Returning 404 to user: Instance 1a4f1963-1182-4b7f-8347-100ee3382934 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:53.181023 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e532f6ee-6682-4b1c-8344-c1dbbfe12e07 tempest-AttachVolumeNegativeTest-1772091373 tempest-AttachVolumeNegativeTest-1772091373-project] 10.222.0.25 "GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934" status: 404 len: 111 microversion: 2.1 time: 0.031851 May 17 18:19:53.181023 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 482/983] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:53 2022] GET /compute/v2.1/servers/1a4f1963-1182-4b7f-8347-100ee3382934 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:55.049149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-af23e95d-351b-4b39-bd99-f0c240d5cb34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:55.049677 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-af23e95d-351b-4b39-bd99-f0c240d5cb34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:55.057324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-af23e95d-351b-4b39-bd99-f0c240d5cb34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:55.057871 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-af23e95d-351b-4b39-bd99-f0c240d5cb34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.058619 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-af23e95d-351b-4b39-bd99-f0c240d5cb34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:55.059186 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-af23e95d-351b-4b39-bd99-f0c240d5cb34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.074371 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-af23e95d-351b-4b39-bd99-f0c240d5cb34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] HTTP exception thrown: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-af23e95d-351b-4b39-bd99-f0c240d5cb34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Request method failure captured: May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: DELETE /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c HTTP/1.1 May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WwrK1zhQPlNa0O5rU9u5rx4UpWlmG6bI1E4WoakKVpT4nD2EzSnM0QqKXRSQyYhmXL5BYVE6TSYETf2FtlhukT27kePUlnRi8fVmocTgsQhii7m58J-RKq3pLrRvfH2i_eNNCvHH4YoevVmaK4XhJQ5rqhXziWDPIYxutWIlyHPME May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: c087a662f09843faa87b942c9462ec67 May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:19:55.076917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c087a662f09843faa87b942c9462ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c087a662f09843faa87b942c9462ec67", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: c087a662f09843faa87b942c9462ec67 May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 17c2097983df461eb7c23bc0ed7b7520 May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:55.078524 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': 'ee1d264e-2d3a-4a16-9a14-1c7d756c620c'} May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:55.079594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:55.081196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:55.083477 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-af23e95d-351b-4b39-bd99-f0c240d5cb34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Returning 404 to user: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:55.084425 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-af23e95d-351b-4b39-bd99-f0c240d5cb34 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 404 len: 111 microversion: 2.1 time: 0.039483 May 17 18:19:55.085219 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 502/984] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:19:55 2022] DELETE /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:55.094815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-070e2735-06f2-4b5c-94f8-a9d388d054da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:55.095428 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-070e2735-06f2-4b5c-94f8-a9d388d054da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: ee1d264e-2d3a-4a16-9a14-1c7d756c620c] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:55.104108 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-070e2735-06f2-4b5c-94f8-a9d388d054da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:55.104621 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-070e2735-06f2-4b5c-94f8-a9d388d054da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.105319 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-070e2735-06f2-4b5c-94f8-a9d388d054da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:55.105770 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-070e2735-06f2-4b5c-94f8-a9d388d054da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.123127 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-070e2735-06f2-4b5c-94f8-a9d388d054da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] HTTP exception thrown: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-070e2735-06f2-4b5c-94f8-a9d388d054da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Request method failure captured: May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c HTTP/1.1 May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WwrK1zhQPlNa0O5rU9u5rx4UpWlmG6bI1E4WoakKVpT4nD2EzSnM0QqKXRSQyYhmXL5BYVE6TSYETf2FtlhukT27kePUlnRi8fVmocTgsQhii7m58J-RKq3pLrRvfH2i_eNNCvHH4YoevVmaK4XhJQ5rqhXziWDPIYxutWIlyHPME May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: c087a662f09843faa87b942c9462ec67 May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:19:55.125188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c087a662f09843faa87b942c9462ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c087a662f09843faa87b942c9462ec67", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: c087a662f09843faa87b942c9462ec67 May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 17c2097983df461eb7c23bc0ed7b7520 May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:55.126768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': 'ee1d264e-2d3a-4a16-9a14-1c7d756c620c'} May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:55.127718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. May 17 18:19:55.129139 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:55.130601 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-070e2735-06f2-4b5c-94f8-a9d388d054da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Returning 404 to user: Instance ee1d264e-2d3a-4a16-9a14-1c7d756c620c could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:55.130601 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-070e2735-06f2-4b5c-94f8-a9d388d054da tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c" status: 404 len: 111 microversion: 2.1 time: 0.037364 May 17 18:19:55.130601 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 483/985] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:55 2022] GET /compute/v2.1/servers/ee1d264e-2d3a-4a16-9a14-1c7d756c620c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:56.338088 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d4dcffbe-5359-47a9-b663-c8d7d062e06c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:56.339663 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d4dcffbe-5359-47a9-b663-c8d7d062e06c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:56.348576 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4dcffbe-5359-47a9-b663-c8d7d062e06c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:56.349279 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4dcffbe-5359-47a9-b663-c8d7d062e06c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:56.350236 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4dcffbe-5359-47a9-b663-c8d7d062e06c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:56.351057 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d4dcffbe-5359-47a9-b663-c8d7d062e06c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:56.368316 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-d4dcffbe-5359-47a9-b663-c8d7d062e06c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] HTTP exception thrown: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d4dcffbe-5359-47a9-b663-c8d7d062e06c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Request method failure captured: May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: DELETE /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 HTTP/1.1 May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WwrK1zhQPlNa0O5rU9u5rx4UpWlmG6bI1E4WoakKVpT4nD2EzSnM0QqKXRSQyYhmXL5BYVE6TSYETf2FtlhukT27kePUlnRi8fVmocTgsQhii7m58J-RKq3pLrRvfH2i_eNNCvHH4YoevVmaK4XhJQ5rqhXziWDPIYxutWIlyHPME May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: c087a662f09843faa87b942c9462ec67 May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:19:56.369977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c087a662f09843faa87b942c9462ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c087a662f09843faa87b942c9462ec67", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: c087a662f09843faa87b942c9462ec67 May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 17c2097983df461eb7c23bc0ed7b7520 May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:19:56.371563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': 'dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7'} May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:56.372692 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:19:56.374162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:19:56.375699 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d4dcffbe-5359-47a9-b663-c8d7d062e06c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Returning 404 to user: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:56.375699 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d4dcffbe-5359-47a9-b663-c8d7d062e06c tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 404 len: 111 microversion: 2.1 time: 0.037699 May 17 18:19:56.375699 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 503/986] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:19:56 2022] DELETE /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:56.381757 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c8a077db-2d8b-4318-81cf-c9fa38072689 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:56.382362 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c8a077db-2d8b-4318-81cf-c9fa38072689 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] [instance: dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:56.389353 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c8a077db-2d8b-4318-81cf-c9fa38072689 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:56.389802 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c8a077db-2d8b-4318-81cf-c9fa38072689 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:56.390600 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c8a077db-2d8b-4318-81cf-c9fa38072689 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:56.391085 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c8a077db-2d8b-4318-81cf-c9fa38072689 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:56.406278 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-c8a077db-2d8b-4318-81cf-c9fa38072689 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] HTTP exception thrown: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c8a077db-2d8b-4318-81cf-c9fa38072689 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Request method failure captured: May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 HTTP/1.1 May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WwrK1zhQPlNa0O5rU9u5rx4UpWlmG6bI1E4WoakKVpT4nD2EzSnM0QqKXRSQyYhmXL5BYVE6TSYETf2FtlhukT27kePUlnRi8fVmocTgsQhii7m58J-RKq3pLrRvfH2i_eNNCvHH4YoevVmaK4XhJQ5rqhXziWDPIYxutWIlyHPME May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: c087a662f09843faa87b942c9462ec67 May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:19:56.407861 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c087a662f09843faa87b942c9462ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c087a662f09843faa87b942c9462ec67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c087a662f09843faa87b942c9462ec67", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: c087a662f09843faa87b942c9462ec67 May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1557935859 May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 17c2097983df461eb7c23bc0ed7b7520 May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeTestJSON-1557935859-project May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:19:56.409874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': 'dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7'} May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:56.410841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. May 17 18:19:56.412468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:19:56.413806 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c8a077db-2d8b-4318-81cf-c9fa38072689 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] Returning 404 to user: Instance dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:56.413806 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c8a077db-2d8b-4318-81cf-c9fa38072689 tempest-AttachVolumeTestJSON-1557935859 tempest-AttachVolumeTestJSON-1557935859-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7" status: 404 len: 111 microversion: 2.1 time: 0.031852 May 17 18:19:56.413806 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 484/987] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:19:56 2022] GET /compute/v2.1/servers/dfc6d85d-d3ba-40ec-bb89-6bad9b3d47d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:58.234210 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5efeebb0-0fec-4ceb-9ea6-2c2608b207b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:58.235799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5efeebb0-0fec-4ceb-9ea6-2c2608b207b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:58.242258 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5efeebb0-0fec-4ceb-9ea6-2c2608b207b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:58.242765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5efeebb0-0fec-4ceb-9ea6-2c2608b207b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:58.243558 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5efeebb0-0fec-4ceb-9ea6-2c2608b207b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:58.244006 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5efeebb0-0fec-4ceb-9ea6-2c2608b207b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:58.275598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5efeebb0-0fec-4ceb-9ea6-2c2608b207b5 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045281 May 17 18:19:58.276531 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 504/988] 10.222.0.25 () {60 vars in 1342 bytes} [Tue May 17 18:19:58 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:58.338865 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a8256be2-c04e-4aad-9426-4927e3490ea3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:58.340784 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a8256be2-c04e-4aad-9426-4927e3490ea3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:58.348096 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8256be2-c04e-4aad-9426-4927e3490ea3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:58.348555 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8256be2-c04e-4aad-9426-4927e3490ea3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:58.349338 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8256be2-c04e-4aad-9426-4927e3490ea3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:58.349799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a8256be2-c04e-4aad-9426-4927e3490ea3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:58.384972 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a8256be2-c04e-4aad-9426-4927e3490ea3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Going to try to terminate instance {{(pid=117020) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:19:58.486204 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a8256be2-c04e-4aad-9426-4927e3490ea3 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 204 len: 0 microversion: 2.20 time: 0.150648 May 17 18:19:58.491560 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 485/989] 10.222.0.25 () {60 vars in 1279 bytes} [Tue May 17 18:19:58 2022] DELETE /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 18:19:58.500370 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f1da9d90-2140-4f29-a75c-77baa9a8d1db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:58.501240 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f1da9d90-2140-4f29-a75c-77baa9a8d1db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:58.510143 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f1da9d90-2140-4f29-a75c-77baa9a8d1db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:58.510802 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f1da9d90-2140-4f29-a75c-77baa9a8d1db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:58.511698 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f1da9d90-2140-4f29-a75c-77baa9a8d1db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:58.512591 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f1da9d90-2140-4f29-a75c-77baa9a8d1db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:58.739737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f1da9d90-2140-4f29-a75c-77baa9a8d1db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:58.749296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f1da9d90-2140-4f29-a75c-77baa9a8d1db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:58.751344 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f1da9d90-2140-4f29-a75c-77baa9a8d1db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:58.755821 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f1da9d90-2140-4f29-a75c-77baa9a8d1db tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.261902 May 17 18:19:58.756739 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 505/990] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:58 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:19:59.775283 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-483cf613-b1fa-4d1f-9b8c-fbb8b27fed9f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:59.776488 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-483cf613-b1fa-4d1f-9b8c-fbb8b27fed9f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:59.784188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-483cf613-b1fa-4d1f-9b8c-fbb8b27fed9f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:59.791395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-483cf613-b1fa-4d1f-9b8c-fbb8b27fed9f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:59.792475 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-483cf613-b1fa-4d1f-9b8c-fbb8b27fed9f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:59.794886 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-483cf613-b1fa-4d1f-9b8c-fbb8b27fed9f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:00.051464 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-483cf613-b1fa-4d1f-9b8c-fbb8b27fed9f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:00.071522 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-483cf613-b1fa-4d1f-9b8c-fbb8b27fed9f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:00.075167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-483cf613-b1fa-4d1f-9b8c-fbb8b27fed9f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:00.079652 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-483cf613-b1fa-4d1f-9b8c-fbb8b27fed9f tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1724 microversion: 2.20 time: 0.308931 May 17 18:20:00.080756 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 486/991] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:19:59 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:20:01.099270 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-da4254ca-a0f9-403b-acf5-31b7bf4e2d9e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:01.100238 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-da4254ca-a0f9-403b-acf5-31b7bf4e2d9e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:01.114623 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-da4254ca-a0f9-403b-acf5-31b7bf4e2d9e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:01.116419 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-da4254ca-a0f9-403b-acf5-31b7bf4e2d9e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:01.119438 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-da4254ca-a0f9-403b-acf5-31b7bf4e2d9e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:01.122335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-da4254ca-a0f9-403b-acf5-31b7bf4e2d9e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:01.150365 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-877e500b-0faa-41ce-81c8-36cc90e9dd74 req-0adaea75-6479-477a-a718-3cfc48b7b9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b911090-a501-452a-a039-bb3a83c3055b", "name": "network-vif-deleted", "tag": "616eb23c-cba6-4708-a5fb-a61c3ccb7b2c"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:01.159111 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-877e500b-0faa-41ce-81c8-36cc90e9dd74 req-0adaea75-6479-477a-a718-3cfc48b7b9b1 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:01.159428 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-877e500b-0faa-41ce-81c8-36cc90e9dd74 req-0adaea75-6479-477a-a718-3cfc48b7b9b1 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:01.173164 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-877e500b-0faa-41ce-81c8-36cc90e9dd74 req-0adaea75-6479-477a-a718-3cfc48b7b9b1 service nova] Creating event network-vif-deleted:616eb23c-cba6-4708-a5fb-a61c3ccb7b2c for instance 1b911090-a501-452a-a039-bb3a83c3055b on hv-cinder-84130 May 17 18:20:01.179685 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-877e500b-0faa-41ce-81c8-36cc90e9dd74 req-0adaea75-6479-477a-a718-3cfc48b7b9b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 May 17 18:20:01.180817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 487/992] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:20:01.257701 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-da4254ca-a0f9-403b-acf5-31b7bf4e2d9e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:01.273431 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-da4254ca-a0f9-403b-acf5-31b7bf4e2d9e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:01.274958 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-da4254ca-a0f9-403b-acf5-31b7bf4e2d9e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ba97b67ecf64476a630fd3667d617fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492389142d804ad392267cb4a728008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:01.278025 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-da4254ca-a0f9-403b-acf5-31b7bf4e2d9e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 200 len: 1656 microversion: 2.20 time: 0.183624 May 17 18:20:01.279673 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 506/993] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:20:01 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 1656 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:20:02.297779 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fa8591f7-422a-4ab9-bc7e-d9b269d3b254 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:02.299175 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fa8591f7-422a-4ab9-bc7e-d9b269d3b254 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:02.305969 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fa8591f7-422a-4ab9-bc7e-d9b269d3b254 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:02.307193 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fa8591f7-422a-4ab9-bc7e-d9b269d3b254 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:02.314538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fa8591f7-422a-4ab9-bc7e-d9b269d3b254 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:02.315686 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fa8591f7-422a-4ab9-bc7e-d9b269d3b254 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:02.334021 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-fa8591f7-422a-4ab9-bc7e-d9b269d3b254 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] HTTP exception thrown: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fa8591f7-422a-4ab9-bc7e-d9b269d3b254 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Request method failure captured: May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b HTTP/1.1 May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WghKt9EBDilQWOFZow_WwG159nr2-sRRLv1v99jXI3xJduS9MSEP3m4HaNve0y516mWpgdseao36rUrXKOTj8Emy2RORzFZz6b7MZN1Q_YirN4Fbk7uHaXLXR8O0QshqqyGYn64DV4ZQMbBo1KFgdQbl6-gTxjOIzwtm4tiBV6yQs May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 492389142d804ad392267cb4a728008d May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:20:02.335954 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/492389142d804ad392267cb4a728008d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_492389142d804ad392267cb4a728008d", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 492389142d804ad392267cb4a728008d May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 8ba97b67ecf64476a630fd3667d617fb May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:02.337651 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '1b911090-a501-452a-a039-bb3a83c3055b'} May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:20:02.338538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:02.339786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:02.340879 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fa8591f7-422a-4ab9-bc7e-d9b269d3b254 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Returning 404 to user: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:20:02.340879 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fa8591f7-422a-4ab9-bc7e-d9b269d3b254 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 404 len: 111 microversion: 2.20 time: 0.044441 May 17 18:20:02.340879 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 488/994] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:20:02 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 18:20:02.347086 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-423895af-a2c5-4ca4-b595-b1b0a37cc4df tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '.version_select at 0x7f74ab63f040>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:02.369166 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-423895af-a2c5-4ca4-b595-b1b0a37cc4df tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-953545754" status: 204 len: 0 microversion: 2.20 time: 0.026458 May 17 18:20:02.370161 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 507/995] 10.222.0.25 () {60 vars in 1258 bytes} [Tue May 17 18:20:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-953545754 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 18:20:04.398638 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-33fc25cd-21b0-4988-9fc2-59160333a425 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:04.399924 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-33fc25cd-21b0-4988-9fc2-59160333a425 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:04.407892 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33fc25cd-21b0-4988-9fc2-59160333a425 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:04.408412 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33fc25cd-21b0-4988-9fc2-59160333a425 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:04.409283 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33fc25cd-21b0-4988-9fc2-59160333a425 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:04.409733 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33fc25cd-21b0-4988-9fc2-59160333a425 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:04.422980 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-33fc25cd-21b0-4988-9fc2-59160333a425 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] HTTP exception thrown: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-33fc25cd-21b0-4988-9fc2-59160333a425 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Request method failure captured: May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: DELETE /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b HTTP/1.1 May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WghKt9EBDilQWOFZow_WwG159nr2-sRRLv1v99jXI3xJduS9MSEP3m4HaNve0y516mWpgdseao36rUrXKOTj8Emy2RORzFZz6b7MZN1Q_YirN4Fbk7uHaXLXR8O0QshqqyGYn64DV4ZQMbBo1KFgdQbl6-gTxjOIzwtm4tiBV6yQs May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 492389142d804ad392267cb4a728008d May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:20:04.425118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/492389142d804ad392267cb4a728008d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_492389142d804ad392267cb4a728008d", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 492389142d804ad392267cb4a728008d May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 8ba97b67ecf64476a630fd3667d617fb May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:04.426811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '1b911090-a501-452a-a039-bb3a83c3055b'} May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:20:04.430694 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:04.432215 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:04.433668 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-33fc25cd-21b0-4988-9fc2-59160333a425 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Returning 404 to user: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:20:04.433668 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-33fc25cd-21b0-4988-9fc2-59160333a425 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 404 len: 111 microversion: 2.20 time: 0.032611 May 17 18:20:04.433668 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 489/996] 10.222.0.25 () {60 vars in 1279 bytes} [Tue May 17 18:20:04 2022] DELETE /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 17 18:20:04.435610 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-87ab1ed8-daee-4f0c-ba3c-0dc01cc0967d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:04.436219 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-87ab1ed8-daee-4f0c-ba3c-0dc01cc0967d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 1b911090-a501-452a-a039-bb3a83c3055b] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:04.442980 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-87ab1ed8-daee-4f0c-ba3c-0dc01cc0967d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:04.443428 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-87ab1ed8-daee-4f0c-ba3c-0dc01cc0967d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:04.444198 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-87ab1ed8-daee-4f0c-ba3c-0dc01cc0967d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:04.444631 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-87ab1ed8-daee-4f0c-ba3c-0dc01cc0967d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:04.458635 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-87ab1ed8-daee-4f0c-ba3c-0dc01cc0967d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] HTTP exception thrown: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-87ab1ed8-daee-4f0c-ba3c-0dc01cc0967d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Request method failure captured: May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b HTTP/1.1 May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WghKt9EBDilQWOFZow_WwG159nr2-sRRLv1v99jXI3xJduS9MSEP3m4HaNve0y516mWpgdseao36rUrXKOTj8Emy2RORzFZz6b7MZN1Q_YirN4Fbk7uHaXLXR8O0QshqqyGYn64DV4ZQMbBo1KFgdQbl6-gTxjOIzwtm4tiBV6yQs May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 492389142d804ad392267cb4a728008d May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:20:04.460164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/492389142d804ad392267cb4a728008d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_492389142d804ad392267cb4a728008d", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 492389142d804ad392267cb4a728008d May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 8ba97b67ecf64476a630fd3667d617fb May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:04.461756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '1b911090-a501-452a-a039-bb3a83c3055b'} May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:20:04.462728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. May 17 18:20:04.463959 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:20:04.465175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-87ab1ed8-daee-4f0c-ba3c-0dc01cc0967d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Returning 404 to user: Instance 1b911090-a501-452a-a039-bb3a83c3055b could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:20:04.465175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-87ab1ed8-daee-4f0c-ba3c-0dc01cc0967d tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b" status: 404 len: 111 microversion: 2.20 time: 0.030341 May 17 18:20:04.465175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 508/997] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:20:04 2022] GET /compute/v2.1/servers/1b911090-a501-452a-a039-bb3a83c3055b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 17 18:20:05.592439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-70c11675-3b3b-4874-a913-5069e5af6f57 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:05.592957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-70c11675-3b3b-4874-a913-5069e5af6f57 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:05.601207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-70c11675-3b3b-4874-a913-5069e5af6f57 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:05.601827 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-70c11675-3b3b-4874-a913-5069e5af6f57 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:05.602938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-70c11675-3b3b-4874-a913-5069e5af6f57 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:05.603550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-70c11675-3b3b-4874-a913-5069e5af6f57 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:05.620149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-70c11675-3b3b-4874-a913-5069e5af6f57 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] HTTP exception thrown: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-70c11675-3b3b-4874-a913-5069e5af6f57 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Request method failure captured: May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: DELETE /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 HTTP/1.1 May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-WghKt9EBDilQWOFZow_WwG159nr2-sRRLv1v99jXI3xJduS9MSEP3m4HaNve0y516mWpgdseao36rUrXKOTj8Emy2RORzFZz6b7MZN1Q_YirN4Fbk7uHaXLXR8O0QshqqyGYn64DV4ZQMbBo1KFgdQbl6-gTxjOIzwtm4tiBV6yQs May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 492389142d804ad392267cb4a728008d May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:20:05.621711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/492389142d804ad392267cb4a728008d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_492389142d804ad392267cb4a728008d", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 492389142d804ad392267cb4a728008d May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 8ba97b67ecf64476a630fd3667d617fb May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:20:05.623346 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '769abf30-807c-41f0-bd94-0809137c0155'} May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:20:05.624112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:20:05.625387 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:05.626641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-70c11675-3b3b-4874-a913-5069e5af6f57 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Returning 404 to user: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:20:05.626641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-70c11675-3b3b-4874-a913-5069e5af6f57 tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 404 len: 111 microversion: 2.20 time: 0.034601 May 17 18:20:05.626641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 490/998] 10.222.0.25 () {60 vars in 1279 bytes} [Tue May 17 18:20:05 2022] DELETE /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 17 18:20:05.632489 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1d8571f3-1194-47cd-9fd8-f6494d506f5e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:05.633109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-1d8571f3-1194-47cd-9fd8-f6494d506f5e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] [instance: 769abf30-807c-41f0-bd94-0809137c0155] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:05.639527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d8571f3-1194-47cd-9fd8-f6494d506f5e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:05.639984 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d8571f3-1194-47cd-9fd8-f6494d506f5e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:05.640756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d8571f3-1194-47cd-9fd8-f6494d506f5e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:05.641196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-1d8571f3-1194-47cd-9fd8-f6494d506f5e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:05.655596 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-1d8571f3-1194-47cd-9fd8-f6494d506f5e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] HTTP exception thrown: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1d8571f3-1194-47cd-9fd8-f6494d506f5e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Request method failure captured: May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 HTTP/1.1 May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-WghKt9EBDilQWOFZow_WwG159nr2-sRRLv1v99jXI3xJduS9MSEP3m4HaNve0y516mWpgdseao36rUrXKOTj8Emy2RORzFZz6b7MZN1Q_YirN4Fbk7uHaXLXR8O0QshqqyGYn64DV4ZQMbBo1KFgdQbl6-gTxjOIzwtm4tiBV6yQs May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: 492389142d804ad392267cb4a728008d May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:20:05.657160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/492389142d804ad392267cb4a728008d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/492389142d804ad392267cb4a728008d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_492389142d804ad392267cb4a728008d", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: 492389142d804ad392267cb4a728008d May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1130015992 May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 8ba97b67ecf64476a630fd3667d617fb May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1130015992-project May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:20:05.658655 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '769abf30-807c-41f0-bd94-0809137c0155'} May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:20:05.660040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. May 17 18:20:05.661296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:20:05.662837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1d8571f3-1194-47cd-9fd8-f6494d506f5e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] Returning 404 to user: Instance 769abf30-807c-41f0-bd94-0809137c0155 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:20:05.662837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1d8571f3-1194-47cd-9fd8-f6494d506f5e tempest-AttachVolumeShelveTestJSON-1130015992 tempest-AttachVolumeShelveTestJSON-1130015992-project] 10.222.0.25 "GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155" status: 404 len: 111 microversion: 2.20 time: 0.030046 May 17 18:20:05.662837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 509/999] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 17 18:20:05 2022] GET /compute/v2.1/servers/769abf30-807c-41f0-bd94-0809137c0155 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 18:20:33.341818 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-299929208", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "networks": [{"uuid": "030fea70-b68d-4ea2-bb11-b7af0c9b341a"}]}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:33.392513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] validate_networks() for [('030fea70-b68d-4ea2-bb11-b7af0c9b341a', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:20:33.749498 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:20:33.749929 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:20:33.750405 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:20:33.750911 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:20:33.751282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:20:33.760508 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:33.760962 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:33.761766 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:33.762227 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:33.779977 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Getting quotas for project 80325ab76d5546bcaa28db2c45cc6515. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:20:33.783880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Getting quotas for user a5be9f84a3b54d1cab7006c0899720aa and project 80325ab76d5546bcaa28db2c45cc6515. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:20:33.794675 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:20:33.797088 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:20:33.849917 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-17db7f42-6b7a-4a96-a39a-ea1e5001f05e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511194 May 17 18:20:33.851942 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 491/1000] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:20:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:20:33.870115 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e5bb8324-b448-4a77-89e1-9b56bddbc059 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:33.870994 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e5bb8324-b448-4a77-89e1-9b56bddbc059 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:33.931977 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e5bb8324-b448-4a77-89e1-9b56bddbc059 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:33.939621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e5bb8324-b448-4a77-89e1-9b56bddbc059 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1213 microversion: 2.1 time: 0.074076 May 17 18:20:33.940299 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 510/1001] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:33 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:34.958767 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-28e612c7-fd5c-49f5-b952-77a4b5a3aa44 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:34.959376 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-28e612c7-fd5c-49f5-b952-77a4b5a3aa44 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:34.965520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-28e612c7-fd5c-49f5-b952-77a4b5a3aa44 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:34.965970 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-28e612c7-fd5c-49f5-b952-77a4b5a3aa44 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:34.966777 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-28e612c7-fd5c-49f5-b952-77a4b5a3aa44 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:34.967213 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-28e612c7-fd5c-49f5-b952-77a4b5a3aa44 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:35.033154 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-28e612c7-fd5c-49f5-b952-77a4b5a3aa44 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:35.041026 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-28e612c7-fd5c-49f5-b952-77a4b5a3aa44 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1217 microversion: 2.1 time: 0.087386 May 17 18:20:35.041574 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 492/1002] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:34 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:36.057733 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-fba0c589-3a1a-4f93-a592-0c692af43c07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:36.058347 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-fba0c589-3a1a-4f93-a592-0c692af43c07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:36.068378 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fba0c589-3a1a-4f93-a592-0c692af43c07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:36.069141 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fba0c589-3a1a-4f93-a592-0c692af43c07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:36.070160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fba0c589-3a1a-4f93-a592-0c692af43c07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:36.070625 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-fba0c589-3a1a-4f93-a592-0c692af43c07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:36.134029 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-fba0c589-3a1a-4f93-a592-0c692af43c07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:36.141407 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-fba0c589-3a1a-4f93-a592-0c692af43c07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1209 microversion: 2.1 time: 0.087583 May 17 18:20:36.141970 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 511/1003] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:36 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:37.158684 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3d4d3dd2-26b9-41b6-b87a-b60f5bd00114 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:37.159298 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3d4d3dd2-26b9-41b6-b87a-b60f5bd00114 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:37.166365 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3d4d3dd2-26b9-41b6-b87a-b60f5bd00114 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:37.166839 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3d4d3dd2-26b9-41b6-b87a-b60f5bd00114 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:37.167658 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3d4d3dd2-26b9-41b6-b87a-b60f5bd00114 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:37.168038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3d4d3dd2-26b9-41b6-b87a-b60f5bd00114 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:37.229864 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3d4d3dd2-26b9-41b6-b87a-b60f5bd00114 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:37.237369 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3d4d3dd2-26b9-41b6-b87a-b60f5bd00114 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1265 microversion: 2.1 time: 0.082629 May 17 18:20:37.237940 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 493/1004] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:37 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:38.256489 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d2318784-d2ec-494d-a12c-183f297f5217 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:38.257102 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d2318784-d2ec-494d-a12c-183f297f5217 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:38.266214 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2318784-d2ec-494d-a12c-183f297f5217 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:38.266696 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2318784-d2ec-494d-a12c-183f297f5217 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:38.267482 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2318784-d2ec-494d-a12c-183f297f5217 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:38.267917 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2318784-d2ec-494d-a12c-183f297f5217 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:38.398462 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d2318784-d2ec-494d-a12c-183f297f5217 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:38.406079 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d2318784-d2ec-494d-a12c-183f297f5217 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.154541 May 17 18:20:38.406671 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 512/1005] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:38 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:38.741026 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-7cc9d253-1bae-4c53-af03-182c9a3b6b0a req-f1b724b6-a6a9-4782-a64f-278180c2bb4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8925c46-f1ca-45b5-8ced-7c4cd40883cd", "tag": "a7da5b1f-58ed-481b-9a9a-23b48a524681"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:38.749080 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-7cc9d253-1bae-4c53-af03-182c9a3b6b0a req-f1b724b6-a6a9-4782-a64f-278180c2bb4e service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:38.749529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-7cc9d253-1bae-4c53-af03-182c9a3b6b0a req-f1b724b6-a6a9-4782-a64f-278180c2bb4e service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:38.761091 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-7cc9d253-1bae-4c53-af03-182c9a3b6b0a req-f1b724b6-a6a9-4782-a64f-278180c2bb4e service nova] Creating event network-changed:a7da5b1f-58ed-481b-9a9a-23b48a524681 for instance a8925c46-f1ca-45b5-8ced-7c4cd40883cd on hv-cinder-84130 May 17 18:20:38.765951 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-7cc9d253-1bae-4c53-af03-182c9a3b6b0a req-f1b724b6-a6a9-4782-a64f-278180c2bb4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029334 May 17 18:20:38.766488 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 494/1006] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:20:39.423310 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-888945ca-07eb-41a7-b27f-a951cbf6b52e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:39.423839 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-888945ca-07eb-41a7-b27f-a951cbf6b52e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:39.431017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-888945ca-07eb-41a7-b27f-a951cbf6b52e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:39.431469 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-888945ca-07eb-41a7-b27f-a951cbf6b52e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:39.432243 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-888945ca-07eb-41a7-b27f-a951cbf6b52e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:39.432685 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-888945ca-07eb-41a7-b27f-a951cbf6b52e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:39.570196 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-888945ca-07eb-41a7-b27f-a951cbf6b52e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:39.577439 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-888945ca-07eb-41a7-b27f-a951cbf6b52e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.158109 May 17 18:20:39.578015 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 513/1007] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:39 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:40.595188 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e05991fa-03ef-4183-9ea5-238059f945ae tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:40.595794 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e05991fa-03ef-4183-9ea5-238059f945ae tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:40.602393 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e05991fa-03ef-4183-9ea5-238059f945ae tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:40.602873 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e05991fa-03ef-4183-9ea5-238059f945ae tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:40.603633 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e05991fa-03ef-4183-9ea5-238059f945ae tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:40.604069 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e05991fa-03ef-4183-9ea5-238059f945ae tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:40.739583 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e05991fa-03ef-4183-9ea5-238059f945ae tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:40.746835 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e05991fa-03ef-4183-9ea5-238059f945ae tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.155970 May 17 18:20:40.747388 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 495/1008] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:40 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:41.765946 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-96a61d05-9a4c-4b4e-afd3-a7e6703d4170 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:41.766557 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-96a61d05-9a4c-4b4e-afd3-a7e6703d4170 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:41.774073 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-96a61d05-9a4c-4b4e-afd3-a7e6703d4170 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:41.774673 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-96a61d05-9a4c-4b4e-afd3-a7e6703d4170 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:41.775468 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-96a61d05-9a4c-4b4e-afd3-a7e6703d4170 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:41.775935 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-96a61d05-9a4c-4b4e-afd3-a7e6703d4170 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:41.918814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-96a61d05-9a4c-4b4e-afd3-a7e6703d4170 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:41.928806 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-96a61d05-9a4c-4b4e-afd3-a7e6703d4170 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.167150 May 17 18:20:41.929388 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 514/1009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:41 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:42.946429 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a796c6de-ff14-4934-80f5-b7f78c924ac1 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:42.947135 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a796c6de-ff14-4934-80f5-b7f78c924ac1 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:42.953973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a796c6de-ff14-4934-80f5-b7f78c924ac1 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:42.954423 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a796c6de-ff14-4934-80f5-b7f78c924ac1 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:42.955228 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a796c6de-ff14-4934-80f5-b7f78c924ac1 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:42.955662 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a796c6de-ff14-4934-80f5-b7f78c924ac1 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:43.087966 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a796c6de-ff14-4934-80f5-b7f78c924ac1 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:43.095142 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a796c6de-ff14-4934-80f5-b7f78c924ac1 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.153645 May 17 18:20:43.095697 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 496/1010] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:42 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:44.112026 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-684fcddd-3eed-4934-a6ed-84cd93dd1812 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:44.112621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-684fcddd-3eed-4934-a6ed-84cd93dd1812 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:44.119728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-684fcddd-3eed-4934-a6ed-84cd93dd1812 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:44.120183 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-684fcddd-3eed-4934-a6ed-84cd93dd1812 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:44.121015 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-684fcddd-3eed-4934-a6ed-84cd93dd1812 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:44.121454 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-684fcddd-3eed-4934-a6ed-84cd93dd1812 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:44.250129 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-684fcddd-3eed-4934-a6ed-84cd93dd1812 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:44.257661 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-684fcddd-3eed-4934-a6ed-84cd93dd1812 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.149600 May 17 18:20:44.258252 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 515/1011] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:44 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:45.275163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-33fd92c8-d126-47e0-9fed-8d1a749c4712 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:45.275779 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-33fd92c8-d126-47e0-9fed-8d1a749c4712 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:45.282089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33fd92c8-d126-47e0-9fed-8d1a749c4712 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:45.282545 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33fd92c8-d126-47e0-9fed-8d1a749c4712 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:45.283340 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33fd92c8-d126-47e0-9fed-8d1a749c4712 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:45.283784 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-33fd92c8-d126-47e0-9fed-8d1a749c4712 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:45.415295 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-33fd92c8-d126-47e0-9fed-8d1a749c4712 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:45.422377 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-33fd92c8-d126-47e0-9fed-8d1a749c4712 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.151150 May 17 18:20:45.422965 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 497/1012] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:45 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:46.439371 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-870425f2-c5d2-4642-8966-ba006159141b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:46.439984 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-870425f2-c5d2-4642-8966-ba006159141b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:46.447273 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-870425f2-c5d2-4642-8966-ba006159141b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:46.447731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-870425f2-c5d2-4642-8966-ba006159141b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:46.448508 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-870425f2-c5d2-4642-8966-ba006159141b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:46.448948 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-870425f2-c5d2-4642-8966-ba006159141b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:46.576284 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-870425f2-c5d2-4642-8966-ba006159141b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:46.583470 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-870425f2-c5d2-4642-8966-ba006159141b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.147922 May 17 18:20:46.584022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 516/1013] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:46 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:47.600149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-557e5701-c138-4193-b34e-b565b773e44f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:47.600758 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-557e5701-c138-4193-b34e-b565b773e44f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:47.607153 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-557e5701-c138-4193-b34e-b565b773e44f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:47.607599 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-557e5701-c138-4193-b34e-b565b773e44f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:47.608388 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-557e5701-c138-4193-b34e-b565b773e44f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:47.608824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-557e5701-c138-4193-b34e-b565b773e44f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:47.736553 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-557e5701-c138-4193-b34e-b565b773e44f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:47.744388 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-557e5701-c138-4193-b34e-b565b773e44f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.148232 May 17 18:20:47.744951 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 498/1014] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:47 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:48.255975 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-53d387f3-2f89-4a4e-8ada-b9964e941afc req-20d7b820-abcd-4acb-add4-9bb21ed14cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8925c46-f1ca-45b5-8ced-7c4cd40883cd", "name": "network-vif-plugged", "status": "completed", "tag": "a7da5b1f-58ed-481b-9a9a-23b48a524681"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:48.264807 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-53d387f3-2f89-4a4e-8ada-b9964e941afc req-20d7b820-abcd-4acb-add4-9bb21ed14cea service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:48.265276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-53d387f3-2f89-4a4e-8ada-b9964e941afc req-20d7b820-abcd-4acb-add4-9bb21ed14cea service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:48.276508 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-53d387f3-2f89-4a4e-8ada-b9964e941afc req-20d7b820-abcd-4acb-add4-9bb21ed14cea service nova] Creating event network-vif-plugged:a7da5b1f-58ed-481b-9a9a-23b48a524681 for instance a8925c46-f1ca-45b5-8ced-7c4cd40883cd on hv-cinder-84130 May 17 18:20:48.281409 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-53d387f3-2f89-4a4e-8ada-b9964e941afc req-20d7b820-abcd-4acb-add4-9bb21ed14cea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029228 May 17 18:20:48.282000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 517/1015] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:20:48.763137 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-15126938-c2c8-480d-b22c-66ec48f8f1cb tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:48.763715 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-15126938-c2c8-480d-b22c-66ec48f8f1cb tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:48.769937 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-15126938-c2c8-480d-b22c-66ec48f8f1cb tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:48.770386 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-15126938-c2c8-480d-b22c-66ec48f8f1cb tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:48.771191 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-15126938-c2c8-480d-b22c-66ec48f8f1cb tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:48.771631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-15126938-c2c8-480d-b22c-66ec48f8f1cb tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:48.902712 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-15126938-c2c8-480d-b22c-66ec48f8f1cb tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:48.911145 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-15126938-c2c8-480d-b22c-66ec48f8f1cb tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.151959 May 17 18:20:48.911715 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 499/1016] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:48 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:49.929249 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b364ccde-f452-4074-8d57-46820090ebf4 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:49.929964 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b364ccde-f452-4074-8d57-46820090ebf4 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:49.936461 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b364ccde-f452-4074-8d57-46820090ebf4 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:49.936922 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b364ccde-f452-4074-8d57-46820090ebf4 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:49.937707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b364ccde-f452-4074-8d57-46820090ebf4 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:49.938145 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b364ccde-f452-4074-8d57-46820090ebf4 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:50.076025 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b364ccde-f452-4074-8d57-46820090ebf4 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:50.083545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b364ccde-f452-4074-8d57-46820090ebf4 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1313 microversion: 2.1 time: 0.159529 May 17 18:20:50.084109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 518/1017] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:49 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:51.101641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2bc35732-609e-438c-bd00-be3b6ada59cf tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:51.102261 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2bc35732-609e-438c-bd00-be3b6ada59cf tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:51.109071 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2bc35732-609e-438c-bd00-be3b6ada59cf tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:51.109542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2bc35732-609e-438c-bd00-be3b6ada59cf tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:51.110327 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2bc35732-609e-438c-bd00-be3b6ada59cf tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:51.110787 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2bc35732-609e-438c-bd00-be3b6ada59cf tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:51.241975 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2bc35732-609e-438c-bd00-be3b6ada59cf tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:51.249594 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2bc35732-609e-438c-bd00-be3b6ada59cf tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1497 microversion: 2.1 time: 0.153432 May 17 18:20:51.250160 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 500/1018] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:51 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:53.375586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-59d8dc53-51c0-4d8f-8107-20a74452b148 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:53.376249 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-59d8dc53-51c0-4d8f-8107-20a74452b148 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:53.383240 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-59d8dc53-51c0-4d8f-8107-20a74452b148 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:53.383697 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-59d8dc53-51c0-4d8f-8107-20a74452b148 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:53.384473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-59d8dc53-51c0-4d8f-8107-20a74452b148 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:53.384926 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-59d8dc53-51c0-4d8f-8107-20a74452b148 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:53.410627 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-59d8dc53-51c0-4d8f-8107-20a74452b148 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:20:53.486354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-59d8dc53-51c0-4d8f-8107-20a74452b148 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 204 len: 0 microversion: 2.1 time: 0.114277 May 17 18:20:53.495496 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e4ec3300-c4af-4aba-af2e-883b98d3c6a9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:53.496220 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e4ec3300-c4af-4aba-af2e-883b98d3c6a9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:53.498768 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 519/1019] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:20:53 2022] DELETE /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:20:53.502623 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e4ec3300-c4af-4aba-af2e-883b98d3c6a9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:53.503081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e4ec3300-c4af-4aba-af2e-883b98d3c6a9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:53.504677 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e4ec3300-c4af-4aba-af2e-883b98d3c6a9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:53.505117 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e4ec3300-c4af-4aba-af2e-883b98d3c6a9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:53.633529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e4ec3300-c4af-4aba-af2e-883b98d3c6a9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:53.640775 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e4ec3300-c4af-4aba-af2e-883b98d3c6a9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1503 microversion: 2.1 time: 0.149463 May 17 18:20:53.641332 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 501/1020] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:53 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:20:54.658634 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f06b9c6a-4802-4cac-94f5-dd40222dbd1d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:54.659330 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f06b9c6a-4802-4cac-94f5-dd40222dbd1d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:54.665961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f06b9c6a-4802-4cac-94f5-dd40222dbd1d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:54.666411 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f06b9c6a-4802-4cac-94f5-dd40222dbd1d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:54.667193 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f06b9c6a-4802-4cac-94f5-dd40222dbd1d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:54.667626 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f06b9c6a-4802-4cac-94f5-dd40222dbd1d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:54.803206 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f06b9c6a-4802-4cac-94f5-dd40222dbd1d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:54.821106 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f06b9c6a-4802-4cac-94f5-dd40222dbd1d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1503 microversion: 2.1 time: 0.166403 May 17 18:20:54.821502 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 520/1021] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:54 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:20:55.742971 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-9d43c53f-671c-47ab-98bf-f1752935853d req-13223b6a-f906-4f2a-8690-62116606f053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8925c46-f1ca-45b5-8ced-7c4cd40883cd", "name": "network-vif-deleted", "tag": "a7da5b1f-58ed-481b-9a9a-23b48a524681"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:55.751520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-9d43c53f-671c-47ab-98bf-f1752935853d req-13223b6a-f906-4f2a-8690-62116606f053 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:55.752002 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-9d43c53f-671c-47ab-98bf-f1752935853d req-13223b6a-f906-4f2a-8690-62116606f053 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:55.764808 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-9d43c53f-671c-47ab-98bf-f1752935853d req-13223b6a-f906-4f2a-8690-62116606f053 service nova] Creating event network-vif-deleted:a7da5b1f-58ed-481b-9a9a-23b48a524681 for instance a8925c46-f1ca-45b5-8ced-7c4cd40883cd on hv-cinder-84130 May 17 18:20:55.773222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-9d43c53f-671c-47ab-98bf-f1752935853d req-13223b6a-f906-4f2a-8690-62116606f053 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033917 May 17 18:20:55.773875 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 502/1022] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:20:55.837350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:55.837972 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:55.844295 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:55.844743 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:55.845609 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:55.846046 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:55.881365 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:55.881815 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:55.882259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lazy-loading 'fault' on Instance uuid a8925c46-f1ca-45b5-8ced-7c4cd40883cd {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:20:55.924234 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:55.932204 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-253e968b-24de-4d91-8df2-793a2bc06bbc tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 200 len: 1303 microversion: 2.1 time: 0.098668 May 17 18:20:55.933067 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 521/1023] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:55 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:56.950364 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d4dcdf15-ffb3-45d6-a58f-1abe131f9131 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:56.951081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d4dcdf15-ffb3-45d6-a58f-1abe131f9131 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: a8925c46-f1ca-45b5-8ced-7c4cd40883cd] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:56.958332 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d4dcdf15-ffb3-45d6-a58f-1abe131f9131 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:56.958805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d4dcdf15-ffb3-45d6-a58f-1abe131f9131 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:56.959574 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d4dcdf15-ffb3-45d6-a58f-1abe131f9131 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:56.960012 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d4dcdf15-ffb3-45d6-a58f-1abe131f9131 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:56.973565 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-d4dcdf15-ffb3-45d6-a58f-1abe131f9131 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] HTTP exception thrown: Instance a8925c46-f1ca-45b5-8ced-7c4cd40883cd could not be found. May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d4dcdf15-ffb3-45d6-a58f-1abe131f9131 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Request method failure captured: May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd HTTP/1.1 May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-dvHWAhiXoXo0L63hxV7uxy0tSgPMKacMDXyUuD1OQ6yBs8WQ_zXjpZEpJeYkD1dUA1AmAeb9tA87xD7KybJUr2n6L2o5kDFTsUjjScRsAzyUpyidWrqiRTEw9dN4xYILvCt3mpeQdGU2pt5WNezDzG_-v0HmyXxHZKtjc_4pRnQhg May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 80325ab76d5546bcaa28db2c45cc6515 May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-VolumesActionsTest-979877801 May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:20:56.975282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/80325ab76d5546bcaa28db2c45cc6515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80325ab76d5546bcaa28db2c45cc6515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80325ab76d5546bcaa28db2c45cc6515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_80325ab76d5546bcaa28db2c45cc6515", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-VolumesActionsTest-979877801 May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 80325ab76d5546bcaa28db2c45cc6515 May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-VolumesActionsTest-979877801 May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-VolumesActionsTest-979877801-project May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: a5be9f84a3b54d1cab7006c0899720aa May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-VolumesActionsTest-979877801-project May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance a8925c46-f1ca-45b5-8ced-7c4cd40883cd could not be found. May 17 18:20:56.976950 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': 'a8925c46-f1ca-45b5-8ced-7c4cd40883cd'} May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8925c46-f1ca-45b5-8ced-7c4cd40883cd could not be found. May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:20:56.977909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8925c46-f1ca-45b5-8ced-7c4cd40883cd could not be found. May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8925c46-f1ca-45b5-8ced-7c4cd40883cd could not be found. May 17 18:20:56.979520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:20:56.980902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d4dcdf15-ffb3-45d6-a58f-1abe131f9131 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Returning 404 to user: Instance a8925c46-f1ca-45b5-8ced-7c4cd40883cd could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:20:56.980902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d4dcdf15-ffb3-45d6-a58f-1abe131f9131 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd" status: 404 len: 111 microversion: 2.1 time: 0.031160 May 17 18:20:56.980902 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 503/1024] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:56 2022] GET /compute/v2.1/servers/a8925c46-f1ca-45b5-8ced-7c4cd40883cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:20:57.024088 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1560012463", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452", "networks": [{"uuid": "030fea70-b68d-4ea2-bb11-b7af0c9b341a"}]}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:57.075141 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.network.neutron [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] validate_networks() for [('030fea70-b68d-4ea2-bb11-b7af0c9b341a', None, None, None, None, None)] {{(pid=117021) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:20:57.424289 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Flavor limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:20:57.424635 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Image limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:20:57.425105 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Flavor pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:20:57.425681 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Image pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:20:57.426144 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:20:57.434962 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:57.435403 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:57.436230 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:57.436665 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:57.453626 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Getting quotas for project 80325ab76d5546bcaa28db2c45cc6515. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:20:57.458532 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Getting quotas for user a5be9f84a3b54d1cab7006c0899720aa and project 80325ab76d5546bcaa28db2c45cc6515. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:20:57.469207 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Going to run 1 instances... {{(pid=117021) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:20:57.471909 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:20:57.521781 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5b55f72f-4112-4938-baa3-f742d4a203c2 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501450 May 17 18:20:57.527927 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 522/1025] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:20:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:20:57.533072 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-79d32a14-e3bb-494e-97e8-f51dcea5e8f9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:57.533688 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-79d32a14-e3bb-494e-97e8-f51dcea5e8f9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:57.594673 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-79d32a14-e3bb-494e-97e8-f51dcea5e8f9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:57.601636 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-79d32a14-e3bb-494e-97e8-f51dcea5e8f9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1214 microversion: 2.1 time: 0.072679 May 17 18:20:57.602916 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 504/1026] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:57 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:20:58.619180 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7dc4ec22-35f5-4192-8ef4-791e1e66848b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:58.619725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7dc4ec22-35f5-4192-8ef4-791e1e66848b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:58.626372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7dc4ec22-35f5-4192-8ef4-791e1e66848b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:58.626847 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7dc4ec22-35f5-4192-8ef4-791e1e66848b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:58.627618 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7dc4ec22-35f5-4192-8ef4-791e1e66848b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:58.628055 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7dc4ec22-35f5-4192-8ef4-791e1e66848b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:58.692088 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7dc4ec22-35f5-4192-8ef4-791e1e66848b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:58.699565 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7dc4ec22-35f5-4192-8ef4-791e1e66848b tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1266 microversion: 2.1 time: 0.084829 May 17 18:20:58.700156 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 523/1027] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:58 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:59.716647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1c4aa234-7790-47d4-ba61-91096c644493 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:59.717283 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1c4aa234-7790-47d4-ba61-91096c644493 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:59.724962 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1c4aa234-7790-47d4-ba61-91096c644493 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:59.725388 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1c4aa234-7790-47d4-ba61-91096c644493 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:59.726149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1c4aa234-7790-47d4-ba61-91096c644493 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:59.726601 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1c4aa234-7790-47d4-ba61-91096c644493 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:59.785802 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1c4aa234-7790-47d4-ba61-91096c644493 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:59.792903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1c4aa234-7790-47d4-ba61-91096c644493 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1266 microversion: 2.1 time: 0.080211 May 17 18:20:59.793448 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 505/1028] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:20:59 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:00.810098 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-78cf6454-8b12-4f46-8da3-ea48f683e49c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:00.810745 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-78cf6454-8b12-4f46-8da3-ea48f683e49c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:00.818100 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-78cf6454-8b12-4f46-8da3-ea48f683e49c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:00.818552 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-78cf6454-8b12-4f46-8da3-ea48f683e49c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:00.819334 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-78cf6454-8b12-4f46-8da3-ea48f683e49c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:00.819768 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-78cf6454-8b12-4f46-8da3-ea48f683e49c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:00.882802 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-78cf6454-8b12-4f46-8da3-ea48f683e49c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:00.889982 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-78cf6454-8b12-4f46-8da3-ea48f683e49c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1266 microversion: 2.1 time: 0.083713 May 17 18:21:00.890554 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 524/1029] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:00 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:01.906555 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1f1d4905-e9ef-4609-861e-46be2f70659c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:01.907343 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1f1d4905-e9ef-4609-861e-46be2f70659c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:01.914191 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1f1d4905-e9ef-4609-861e-46be2f70659c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:01.914557 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1f1d4905-e9ef-4609-861e-46be2f70659c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:01.915364 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1f1d4905-e9ef-4609-861e-46be2f70659c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:01.915805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1f1d4905-e9ef-4609-861e-46be2f70659c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:02.052170 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1f1d4905-e9ef-4609-861e-46be2f70659c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:02.059628 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1f1d4905-e9ef-4609-861e-46be2f70659c tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1314 microversion: 2.1 time: 0.156941 May 17 18:21:02.060206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 506/1030] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:01 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:02.602145 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-a3f01c5d-1335-4fc0-85f9-39f04040bdd7 req-02012401-91ca-4b1c-ba55-57df0cf464df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca9bdaa-b943-4ea6-93d2-44c7841e917e", "tag": "d9a940b8-3b66-45b5-a1b8-d5f0790d2b4b"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:02.610721 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-a3f01c5d-1335-4fc0-85f9-39f04040bdd7 req-02012401-91ca-4b1c-ba55-57df0cf464df service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:02.611303 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-a3f01c5d-1335-4fc0-85f9-39f04040bdd7 req-02012401-91ca-4b1c-ba55-57df0cf464df service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:02.622664 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-a3f01c5d-1335-4fc0-85f9-39f04040bdd7 req-02012401-91ca-4b1c-ba55-57df0cf464df service nova] Creating event network-changed:d9a940b8-3b66-45b5-a1b8-d5f0790d2b4b for instance 4ca9bdaa-b943-4ea6-93d2-44c7841e917e on hv-cinder-84130 May 17 18:21:02.627352 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-a3f01c5d-1335-4fc0-85f9-39f04040bdd7 req-02012401-91ca-4b1c-ba55-57df0cf464df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028972 May 17 18:21:02.627949 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 525/1031] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:03.077897 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a330eda7-1b53-41dc-b44d-ded6b7bb4a38 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:03.078425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a330eda7-1b53-41dc-b44d-ded6b7bb4a38 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:03.084778 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a330eda7-1b53-41dc-b44d-ded6b7bb4a38 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:03.085230 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a330eda7-1b53-41dc-b44d-ded6b7bb4a38 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:03.085994 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a330eda7-1b53-41dc-b44d-ded6b7bb4a38 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:03.086431 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a330eda7-1b53-41dc-b44d-ded6b7bb4a38 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:03.216329 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a330eda7-1b53-41dc-b44d-ded6b7bb4a38 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:03.223982 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a330eda7-1b53-41dc-b44d-ded6b7bb4a38 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1314 microversion: 2.1 time: 0.150091 May 17 18:21:03.224545 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 507/1032] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:03 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:04.242437 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9cb4eca5-ac13-49d2-9226-c20f0923285d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:04.243612 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9cb4eca5-ac13-49d2-9226-c20f0923285d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:04.249824 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9cb4eca5-ac13-49d2-9226-c20f0923285d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:04.250550 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9cb4eca5-ac13-49d2-9226-c20f0923285d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:04.251571 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9cb4eca5-ac13-49d2-9226-c20f0923285d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:04.252081 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9cb4eca5-ac13-49d2-9226-c20f0923285d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:04.384023 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9cb4eca5-ac13-49d2-9226-c20f0923285d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:04.391396 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9cb4eca5-ac13-49d2-9226-c20f0923285d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1314 microversion: 2.1 time: 0.154371 May 17 18:21:04.391953 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 526/1033] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:04 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:05.408164 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4f0b6161-29a9-4d1b-86c0-b26d98ca8f07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:05.408767 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4f0b6161-29a9-4d1b-86c0-b26d98ca8f07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:05.415439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4f0b6161-29a9-4d1b-86c0-b26d98ca8f07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:05.415888 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4f0b6161-29a9-4d1b-86c0-b26d98ca8f07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:05.416644 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4f0b6161-29a9-4d1b-86c0-b26d98ca8f07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:05.417349 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4f0b6161-29a9-4d1b-86c0-b26d98ca8f07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:05.547898 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4f0b6161-29a9-4d1b-86c0-b26d98ca8f07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:05.555666 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4f0b6161-29a9-4d1b-86c0-b26d98ca8f07 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1314 microversion: 2.1 time: 0.151337 May 17 18:21:05.556239 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 508/1034] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:05 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:06.311483 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-7c482db8-9b99-47a4-9ba6-0d95e4c9477d req-5ed8be87-d872-4bb9-beed-1257536b472b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca9bdaa-b943-4ea6-93d2-44c7841e917e", "name": "network-vif-plugged", "status": "completed", "tag": "d9a940b8-3b66-45b5-a1b8-d5f0790d2b4b"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:06.321211 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-7c482db8-9b99-47a4-9ba6-0d95e4c9477d req-5ed8be87-d872-4bb9-beed-1257536b472b service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:06.321630 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-7c482db8-9b99-47a4-9ba6-0d95e4c9477d req-5ed8be87-d872-4bb9-beed-1257536b472b service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:06.336069 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-7c482db8-9b99-47a4-9ba6-0d95e4c9477d req-5ed8be87-d872-4bb9-beed-1257536b472b service nova] Creating event network-vif-plugged:d9a940b8-3b66-45b5-a1b8-d5f0790d2b4b for instance 4ca9bdaa-b943-4ea6-93d2-44c7841e917e on hv-cinder-84130 May 17 18:21:06.340816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-7c482db8-9b99-47a4-9ba6-0d95e4c9477d req-5ed8be87-d872-4bb9-beed-1257536b472b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033043 May 17 18:21:06.341415 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 527/1035] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:06.573233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6f34285d-7d87-43ee-81b9-95001fcbe555 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:06.573855 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6f34285d-7d87-43ee-81b9-95001fcbe555 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:06.580159 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6f34285d-7d87-43ee-81b9-95001fcbe555 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:06.580612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6f34285d-7d87-43ee-81b9-95001fcbe555 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:06.582197 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6f34285d-7d87-43ee-81b9-95001fcbe555 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:06.582677 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6f34285d-7d87-43ee-81b9-95001fcbe555 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:06.712477 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6f34285d-7d87-43ee-81b9-95001fcbe555 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:06.720060 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6f34285d-7d87-43ee-81b9-95001fcbe555 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1314 microversion: 2.1 time: 0.150629 May 17 18:21:06.720672 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 509/1036] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:06 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:07.737656 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9685a543-7906-4fc5-962a-6f2cee1782d9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:07.738372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9685a543-7906-4fc5-962a-6f2cee1782d9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:07.744608 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9685a543-7906-4fc5-962a-6f2cee1782d9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:07.745065 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9685a543-7906-4fc5-962a-6f2cee1782d9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:07.745852 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9685a543-7906-4fc5-962a-6f2cee1782d9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:07.746295 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9685a543-7906-4fc5-962a-6f2cee1782d9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:07.877456 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9685a543-7906-4fc5-962a-6f2cee1782d9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:07.885429 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9685a543-7906-4fc5-962a-6f2cee1782d9 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1314 microversion: 2.1 time: 0.152452 May 17 18:21:07.886219 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 528/1037] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:07 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:08.902854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d5aeec95-7be1-4144-b3e6-0264ff02ba2f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:08.903503 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d5aeec95-7be1-4144-b3e6-0264ff02ba2f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:08.909551 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d5aeec95-7be1-4144-b3e6-0264ff02ba2f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:08.910007 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d5aeec95-7be1-4144-b3e6-0264ff02ba2f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:08.911439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d5aeec95-7be1-4144-b3e6-0264ff02ba2f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:08.911881 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d5aeec95-7be1-4144-b3e6-0264ff02ba2f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:09.038552 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d5aeec95-7be1-4144-b3e6-0264ff02ba2f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:09.045905 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d5aeec95-7be1-4144-b3e6-0264ff02ba2f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1498 microversion: 2.1 time: 0.146951 May 17 18:21:09.046471 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 510/1038] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:08 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:09.463879 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ecca60db-a9d7-422b-a782-27f16c85300e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:09.465131 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ecca60db-a9d7-422b-a782-27f16c85300e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:09.472204 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ecca60db-a9d7-422b-a782-27f16c85300e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:09.472808 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ecca60db-a9d7-422b-a782-27f16c85300e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:09.473694 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ecca60db-a9d7-422b-a782-27f16c85300e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:09.474128 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ecca60db-a9d7-422b-a782-27f16c85300e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:09.501240 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ecca60db-a9d7-422b-a782-27f16c85300e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:21:09.578792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ecca60db-a9d7-422b-a782-27f16c85300e tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 204 len: 0 microversion: 2.1 time: 0.118778 May 17 18:21:09.579464 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 529/1039] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:21:09 2022] DELETE /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:21:09.588474 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8882a5c4-205d-4ee3-ac0a-2dd90dbda42f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:09.589607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8882a5c4-205d-4ee3-ac0a-2dd90dbda42f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:09.595556 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8882a5c4-205d-4ee3-ac0a-2dd90dbda42f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:09.596019 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8882a5c4-205d-4ee3-ac0a-2dd90dbda42f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:09.596788 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8882a5c4-205d-4ee3-ac0a-2dd90dbda42f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:09.597232 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8882a5c4-205d-4ee3-ac0a-2dd90dbda42f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:09.735100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8882a5c4-205d-4ee3-ac0a-2dd90dbda42f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:09.743990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8882a5c4-205d-4ee3-ac0a-2dd90dbda42f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1504 microversion: 2.1 time: 0.159446 May 17 18:21:09.744563 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 511/1040] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:09 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:10.762123 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-09d7a862-7127-4a6e-905d-f20fddf4143d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:10.762902 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-09d7a862-7127-4a6e-905d-f20fddf4143d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:10.769206 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-09d7a862-7127-4a6e-905d-f20fddf4143d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:10.770282 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-09d7a862-7127-4a6e-905d-f20fddf4143d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:10.771217 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-09d7a862-7127-4a6e-905d-f20fddf4143d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:10.771838 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-09d7a862-7127-4a6e-905d-f20fddf4143d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:10.931411 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-09d7a862-7127-4a6e-905d-f20fddf4143d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:10.946775 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-09d7a862-7127-4a6e-905d-f20fddf4143d tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1504 microversion: 2.1 time: 0.188860 May 17 18:21:10.947369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 530/1041] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:10 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:11.481824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-9d2a489b-687c-4db5-a12b-dee169fb6cc8 req-80ef13c2-0056-4e5a-8c9b-5f958ac3b071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca9bdaa-b943-4ea6-93d2-44c7841e917e", "name": "network-vif-deleted", "tag": "d9a940b8-3b66-45b5-a1b8-d5f0790d2b4b"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:11.494726 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-9d2a489b-687c-4db5-a12b-dee169fb6cc8 req-80ef13c2-0056-4e5a-8c9b-5f958ac3b071 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:11.495201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-9d2a489b-687c-4db5-a12b-dee169fb6cc8 req-80ef13c2-0056-4e5a-8c9b-5f958ac3b071 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:11.506967 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-9d2a489b-687c-4db5-a12b-dee169fb6cc8 req-80ef13c2-0056-4e5a-8c9b-5f958ac3b071 service nova] Creating event network-vif-deleted:d9a940b8-3b66-45b5-a1b8-d5f0790d2b4b for instance 4ca9bdaa-b943-4ea6-93d2-44c7841e917e on hv-cinder-84130 May 17 18:21:11.513123 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-9d2a489b-687c-4db5-a12b-dee169fb6cc8 req-80ef13c2-0056-4e5a-8c9b-5f958ac3b071 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035085 May 17 18:21:11.513734 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 512/1042] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:11.965943 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:11.966566 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:11.974309 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:11.975059 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:11.976107 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:11.976713 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:12.010039 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:12.010453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:12.010937 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.objects.instance [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lazy-loading 'fault' on Instance uuid 4ca9bdaa-b943-4ea6-93d2-44c7841e917e {{(pid=117021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:21:12.054375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5be9f84a3b54d1cab7006c0899720aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80325ab76d5546bcaa28db2c45cc6515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:12.061707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ddd368a9-4d7a-4a72-ada5-ee4df95ed11f tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 200 len: 1304 microversion: 2.1 time: 0.100844 May 17 18:21:12.062283 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 531/1043] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:11 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:13.082428 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0b1c1a4d-e604-40b1-9b66-f161ea0d9447 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:13.083180 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0b1c1a4d-e604-40b1-9b66-f161ea0d9447 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] [instance: 4ca9bdaa-b943-4ea6-93d2-44c7841e917e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:13.089356 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0b1c1a4d-e604-40b1-9b66-f161ea0d9447 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:13.089810 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0b1c1a4d-e604-40b1-9b66-f161ea0d9447 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:13.090592 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0b1c1a4d-e604-40b1-9b66-f161ea0d9447 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:13.091054 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0b1c1a4d-e604-40b1-9b66-f161ea0d9447 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:13.106486 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-0b1c1a4d-e604-40b1-9b66-f161ea0d9447 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] HTTP exception thrown: Instance 4ca9bdaa-b943-4ea6-93d2-44c7841e917e could not be found. May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0b1c1a4d-e604-40b1-9b66-f161ea0d9447 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Request method failure captured: May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e HTTP/1.1 May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-dvHWAhiXoXo0L63hxV7uxy0tSgPMKacMDXyUuD1OQ6yBs8WQ_zXjpZEpJeYkD1dUA1AmAeb9tA87xD7KybJUr2n6L2o5kDFTsUjjScRsAzyUpyidWrqiRTEw9dN4xYILvCt3mpeQdGU2pt5WNezDzG_-v0HmyXxHZKtjc_4pRnQhg May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 80325ab76d5546bcaa28db2c45cc6515 May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-VolumesActionsTest-979877801 May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:21:13.108163 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/80325ab76d5546bcaa28db2c45cc6515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80325ab76d5546bcaa28db2c45cc6515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80325ab76d5546bcaa28db2c45cc6515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_80325ab76d5546bcaa28db2c45cc6515", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-VolumesActionsTest-979877801 May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 80325ab76d5546bcaa28db2c45cc6515 May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-VolumesActionsTest-979877801 May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-VolumesActionsTest-979877801-project May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: a5be9f84a3b54d1cab7006c0899720aa May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-VolumesActionsTest-979877801-project May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 4ca9bdaa-b943-4ea6-93d2-44c7841e917e could not be found. May 17 18:21:13.110805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '4ca9bdaa-b943-4ea6-93d2-44c7841e917e'} May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca9bdaa-b943-4ea6-93d2-44c7841e917e could not be found. May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:21:13.112459 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca9bdaa-b943-4ea6-93d2-44c7841e917e could not be found. May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca9bdaa-b943-4ea6-93d2-44c7841e917e could not be found. May 17 18:21:13.114288 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:21:13.115759 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0b1c1a4d-e604-40b1-9b66-f161ea0d9447 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] Returning 404 to user: Instance 4ca9bdaa-b943-4ea6-93d2-44c7841e917e could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:21:13.115759 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0b1c1a4d-e604-40b1-9b66-f161ea0d9447 tempest-VolumesActionsTest-979877801 tempest-VolumesActionsTest-979877801-project] 10.222.0.25 "GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e" status: 404 len: 111 microversion: 2.1 time: 0.032569 May 17 18:21:13.115759 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 513/1044] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:13 2022] GET /compute/v2.1/servers/4ca9bdaa-b943-4ea6-93d2-44c7841e917e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:21:34.772000 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-1b6873e8-0b0b-4268-a7df-3ed94a040b83 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Action: 'create', calling method: .version_select at 0x7f74bce70790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1599786495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoFikPX0PhLsJY99IYaf+8sIOXX1M/Oi+WBd0wmISevSTTcAj2G+wGZAOAhTkhm1xDoPZ0CNxSBHa7gZFxvmiC97jZL3A+RHtwCqIHV9IWVUfn9APCHjoxoyXAXNlwqbw=="}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:34.790392 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-1b6873e8-0b0b-4268-a7df-3ed94a040b83 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Getting quotas for project 43c948c388ed4ad7bd63255d5c643e11. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:21:34.796564 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-1b6873e8-0b0b-4268-a7df-3ed94a040b83 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Getting quotas for user 240c3f3cc9e943a883e08e6c096edc51 and project 43c948c388ed4ad7bd63255d5c643e11. Resources: {'key_pairs'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:21:34.838208 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-1b6873e8-0b0b-4268-a7df-3ed94a040b83 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.328830 May 17 18:21:34.844868 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 532/1045] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 17 18:21:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:46.366840 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1086780436", "imageRef": "4aecb750-d627-4568-8228-1e4a67bbabb3", "flavorRef": "452"}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:46.415791 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] validate_networks() for None {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:21:46.691118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:21:46.691546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:21:46.692019 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:21:46.692690 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:21:46.693098 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:21:46.702052 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:46.702415 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:46.703243 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:46.703676 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:46.730637 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Getting quotas for project 8db856deb8834218acc26f7af5dfbe00. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:21:46.734657 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Getting quotas for user 009134b036194923891214978273ac63 and project 8db856deb8834218acc26f7af5dfbe00. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:21:46.746133 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:21:46.748434 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aecb750-d627-4568-8228-1e4a67bbabb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:21:46.793443 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3c3508a8-d4a7-44a2-858f-bec6d344a271 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.432052 May 17 18:21:46.794078 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 514/1046] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:21:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:21:46.804164 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-09173df8-870d-4ace-9cce-18fedad32519 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:46.804870 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-09173df8-870d-4ace-9cce-18fedad32519 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:46.861228 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-09173df8-870d-4ace-9cce-18fedad32519 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:46.869065 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-09173df8-870d-4ace-9cce-18fedad32519 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1215 microversion: 2.1 time: 0.068754 May 17 18:21:46.869987 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 533/1047] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:46 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:47.887700 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-994e6395-e4b6-46ad-9136-2efbc41edc6a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:47.888602 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-994e6395-e4b6-46ad-9136-2efbc41edc6a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:47.895059 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-994e6395-e4b6-46ad-9136-2efbc41edc6a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:47.895515 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-994e6395-e4b6-46ad-9136-2efbc41edc6a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:47.896303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-994e6395-e4b6-46ad-9136-2efbc41edc6a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:47.896772 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-994e6395-e4b6-46ad-9136-2efbc41edc6a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:47.964053 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-994e6395-e4b6-46ad-9136-2efbc41edc6a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:47.972512 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-994e6395-e4b6-46ad-9136-2efbc41edc6a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1273 microversion: 2.1 time: 0.089141 May 17 18:21:47.973088 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 515/1048] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:47 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:48.990784 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-02f3e2a3-b8d3-401b-a1b4-99f54d508a58 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:48.991487 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-02f3e2a3-b8d3-401b-a1b4-99f54d508a58 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:48.997770 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-02f3e2a3-b8d3-401b-a1b4-99f54d508a58 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:48.998226 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-02f3e2a3-b8d3-401b-a1b4-99f54d508a58 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:48.999243 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-02f3e2a3-b8d3-401b-a1b4-99f54d508a58 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:48.999685 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-02f3e2a3-b8d3-401b-a1b4-99f54d508a58 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:49.132806 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-02f3e2a3-b8d3-401b-a1b4-99f54d508a58 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:49.139911 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-02f3e2a3-b8d3-401b-a1b4-99f54d508a58 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1315 microversion: 2.1 time: 0.153815 May 17 18:21:49.140484 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 534/1049] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:48 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:49.535647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-69cc2028-33d8-48f7-b882-51a4230b2d46 req-19dbb247-6519-4bb3-a4b6-a2a89a89173c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f01a7cb-bd9d-453f-a26c-1b8356d7789e", "tag": "cf03cfed-e063-49ac-9788-9de2bab164d5"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:49.545493 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-69cc2028-33d8-48f7-b882-51a4230b2d46 req-19dbb247-6519-4bb3-a4b6-a2a89a89173c service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:49.545961 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-69cc2028-33d8-48f7-b882-51a4230b2d46 req-19dbb247-6519-4bb3-a4b6-a2a89a89173c service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:49.569529 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-69cc2028-33d8-48f7-b882-51a4230b2d46 req-19dbb247-6519-4bb3-a4b6-a2a89a89173c service nova] Creating event network-changed:cf03cfed-e063-49ac-9788-9de2bab164d5 for instance 4f01a7cb-bd9d-453f-a26c-1b8356d7789e on hv-cinder-84130 May 17 18:21:49.575912 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-69cc2028-33d8-48f7-b882-51a4230b2d46 req-19dbb247-6519-4bb3-a4b6-a2a89a89173c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049407 May 17 18:21:49.577097 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 516/1050] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:50.156832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-237b210f-c434-471e-88de-987205d9477a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:50.157473 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-237b210f-c434-471e-88de-987205d9477a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:50.163821 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-237b210f-c434-471e-88de-987205d9477a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:50.164267 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-237b210f-c434-471e-88de-987205d9477a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:50.165022 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-237b210f-c434-471e-88de-987205d9477a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:50.165453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-237b210f-c434-471e-88de-987205d9477a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:50.293494 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-237b210f-c434-471e-88de-987205d9477a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:50.301535 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-237b210f-c434-471e-88de-987205d9477a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1315 microversion: 2.1 time: 0.148221 May 17 18:21:50.302101 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 535/1051] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:50 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:51.318038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7856b05e-3e9a-401a-a2eb-a84b067152b3 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:51.318753 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7856b05e-3e9a-401a-a2eb-a84b067152b3 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:51.325242 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7856b05e-3e9a-401a-a2eb-a84b067152b3 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:51.325692 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7856b05e-3e9a-401a-a2eb-a84b067152b3 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:51.326448 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7856b05e-3e9a-401a-a2eb-a84b067152b3 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:51.326922 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7856b05e-3e9a-401a-a2eb-a84b067152b3 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:51.462734 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7856b05e-3e9a-401a-a2eb-a84b067152b3 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:51.470053 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7856b05e-3e9a-401a-a2eb-a84b067152b3 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1315 microversion: 2.1 time: 0.156574 May 17 18:21:51.470630 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 517/1052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:51 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:52.487408 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3f0b525f-28a6-46e4-8575-c75accfdd2d0 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:52.488020 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3f0b525f-28a6-46e4-8575-c75accfdd2d0 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:52.494340 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f0b525f-28a6-46e4-8575-c75accfdd2d0 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:52.494841 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f0b525f-28a6-46e4-8575-c75accfdd2d0 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:52.495617 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f0b525f-28a6-46e4-8575-c75accfdd2d0 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:52.496060 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3f0b525f-28a6-46e4-8575-c75accfdd2d0 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:52.624553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-3f0b525f-28a6-46e4-8575-c75accfdd2d0 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:52.632477 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3f0b525f-28a6-46e4-8575-c75accfdd2d0 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1315 microversion: 2.1 time: 0.149049 May 17 18:21:52.633041 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 536/1053] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:52 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:53.649858 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-c1e87b1f-2428-4cfe-b1c8-3ebda627753a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:53.650475 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-c1e87b1f-2428-4cfe-b1c8-3ebda627753a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:53.656917 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c1e87b1f-2428-4cfe-b1c8-3ebda627753a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:53.657367 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c1e87b1f-2428-4cfe-b1c8-3ebda627753a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:53.658179 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c1e87b1f-2428-4cfe-b1c8-3ebda627753a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:53.658690 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-c1e87b1f-2428-4cfe-b1c8-3ebda627753a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:53.783600 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-c1e87b1f-2428-4cfe-b1c8-3ebda627753a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:53.791260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-c1e87b1f-2428-4cfe-b1c8-3ebda627753a tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1315 microversion: 2.1 time: 0.145290 May 17 18:21:53.791851 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 518/1054] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:53 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:53.847301 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2111966495", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1599786495", "security_groups": [{"name": "tempest-secgroup-smoke-166663957"}], "networks": [{"uuid": "2c05c687-cce1-4207-a0e0-4e66e64aea31"}], "block_device_mapping_v2": [{"uuid": "2cba790c-55e4-49e8-b8cb-dccf193ec2be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:53.953922 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.network.neutron [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] validate_networks() for [('2c05c687-cce1-4207-a0e0-4e66e64aea31', None, None, None, None, None)] {{(pid=117021) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:21:54.309681 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Flavor limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:21:54.310833 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Image limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:21:54.311374 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Flavor pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:21:54.311800 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Image pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:21:54.312229 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:21:54.321855 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:54.322306 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:54.323160 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:54.323596 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:54.339942 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Getting quotas for project 43c948c388ed4ad7bd63255d5c643e11. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:21:54.344130 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Getting quotas for user 240c3f3cc9e943a883e08e6c096edc51 and project 43c948c388ed4ad7bd63255d5c643e11. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:21:54.401282 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Going to run 1 instances... {{(pid=117021) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:21:54.403527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2cba790c-55e4-49e8-b8cb-dccf193ec2be',volume_size=None,volume_type=None)] {{(pid=117021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:21:54.532454 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-3dddb6d0-57fe-4738-bba3-12fc1be752ea tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.689062 May 17 18:21:54.538525 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 537/1055] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:21:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:21:54.543638 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-09fa39d4-3d6b-4a40-abb5-92923cf64670 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:54.544520 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-09fa39d4-3d6b-4a40-abb5-92923cf64670 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:54.596835 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-09fa39d4-3d6b-4a40-abb5-92923cf64670 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:54.603253 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-09fa39d4-3d6b-4a40-abb5-92923cf64670 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1089 microversion: 2.1 time: 0.063445 May 17 18:21:54.603827 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 519/1056] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:54 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1089 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:54.808503 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-2198fe8e-6214-4b90-9eca-55ab03ca9af6 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:54.809390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-2198fe8e-6214-4b90-9eca-55ab03ca9af6 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:54.821334 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2198fe8e-6214-4b90-9eca-55ab03ca9af6 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:54.822801 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2198fe8e-6214-4b90-9eca-55ab03ca9af6 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:54.824594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2198fe8e-6214-4b90-9eca-55ab03ca9af6 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:54.825259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2198fe8e-6214-4b90-9eca-55ab03ca9af6 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:54.972956 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-2198fe8e-6214-4b90-9eca-55ab03ca9af6 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:54.980850 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-2198fe8e-6214-4b90-9eca-55ab03ca9af6 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1315 microversion: 2.1 time: 0.176742 May 17 18:21:54.981356 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 538/1057] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:54 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:55.620939 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4961b69a-880b-4e2b-b3e5-32b7acbe9a35 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:55.621579 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4961b69a-880b-4e2b-b3e5-32b7acbe9a35 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:55.629123 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4961b69a-880b-4e2b-b3e5-32b7acbe9a35 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:55.629618 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4961b69a-880b-4e2b-b3e5-32b7acbe9a35 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:55.630414 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4961b69a-880b-4e2b-b3e5-32b7acbe9a35 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:55.630893 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4961b69a-880b-4e2b-b3e5-32b7acbe9a35 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:55.697466 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4961b69a-880b-4e2b-b3e5-32b7acbe9a35 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:55.704558 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4961b69a-880b-4e2b-b3e5-32b7acbe9a35 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1205 microversion: 2.1 time: 0.087657 May 17 18:21:55.705131 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 520/1058] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:55 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1205 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:55.997184 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ad5b64b4-7a0d-4148-b6f5-69bdbda1e40e tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:55.998393 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ad5b64b4-7a0d-4148-b6f5-69bdbda1e40e tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:56.007607 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad5b64b4-7a0d-4148-b6f5-69bdbda1e40e tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:56.008059 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad5b64b4-7a0d-4148-b6f5-69bdbda1e40e tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:56.008854 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad5b64b4-7a0d-4148-b6f5-69bdbda1e40e tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:56.009304 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ad5b64b4-7a0d-4148-b6f5-69bdbda1e40e tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:56.149010 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ad5b64b4-7a0d-4148-b6f5-69bdbda1e40e tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:56.157251 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ad5b64b4-7a0d-4148-b6f5-69bdbda1e40e tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1315 microversion: 2.1 time: 0.163879 May 17 18:21:56.159987 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 539/1059] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:55 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:56.515903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-22905d1c-065a-42c8-aa54-4b5789044f5a req-006e12e7-9756-46be-8758-6aafcd4ce554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f01a7cb-bd9d-453f-a26c-1b8356d7789e", "name": "network-vif-plugged", "status": "completed", "tag": "cf03cfed-e063-49ac-9788-9de2bab164d5"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:56.524622 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-22905d1c-065a-42c8-aa54-4b5789044f5a req-006e12e7-9756-46be-8758-6aafcd4ce554 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:56.525149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-22905d1c-065a-42c8-aa54-4b5789044f5a req-006e12e7-9756-46be-8758-6aafcd4ce554 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:56.541182 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-22905d1c-065a-42c8-aa54-4b5789044f5a req-006e12e7-9756-46be-8758-6aafcd4ce554 service nova] Creating event network-vif-plugged:cf03cfed-e063-49ac-9788-9de2bab164d5 for instance 4f01a7cb-bd9d-453f-a26c-1b8356d7789e on hv-cinder-84130 May 17 18:21:56.547776 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-22905d1c-065a-42c8-aa54-4b5789044f5a req-006e12e7-9756-46be-8758-6aafcd4ce554 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035485 May 17 18:21:56.548576 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 521/1060] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:56.723801 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9b02fe13-64e3-46e9-ad5a-e4a05a2c6a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:56.724503 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9b02fe13-64e3-46e9-ad5a-e4a05a2c6a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:56.731054 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9b02fe13-64e3-46e9-ad5a-e4a05a2c6a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:56.732362 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9b02fe13-64e3-46e9-ad5a-e4a05a2c6a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:56.733294 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9b02fe13-64e3-46e9-ad5a-e4a05a2c6a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:56.733731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9b02fe13-64e3-46e9-ad5a-e4a05a2c6a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:56.888006 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9b02fe13-64e3-46e9-ad5a-e4a05a2c6a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:56.896249 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9b02fe13-64e3-46e9-ad5a-e4a05a2c6a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.177444 May 17 18:21:56.896832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 540/1061] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:56 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:56.973394 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-6c5d400e-2dc4-47c7-8923-b569287ed9bd req-b3c9c3a0-7fc7-45ab-957a-3393d8d82a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d", "tag": "8cd46e6c-881d-4940-bcd6-fc6a73179551"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:56.981665 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-6c5d400e-2dc4-47c7-8923-b569287ed9bd req-b3c9c3a0-7fc7-45ab-957a-3393d8d82a68 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:56.982116 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-6c5d400e-2dc4-47c7-8923-b569287ed9bd req-b3c9c3a0-7fc7-45ab-957a-3393d8d82a68 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:56.995725 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-6c5d400e-2dc4-47c7-8923-b569287ed9bd req-b3c9c3a0-7fc7-45ab-957a-3393d8d82a68 service nova] Creating event network-changed:8cd46e6c-881d-4940-bcd6-fc6a73179551 for instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d on hv-cinder-84130 May 17 18:21:57.001232 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-6c5d400e-2dc4-47c7-8923-b569287ed9bd req-b3c9c3a0-7fc7-45ab-957a-3393d8d82a68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032912 May 17 18:21:57.001834 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 522/1062] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:57.175375 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-13580ebb-1c64-4352-a87c-0a9125a3daef tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:57.176138 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-13580ebb-1c64-4352-a87c-0a9125a3daef tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:57.182343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-13580ebb-1c64-4352-a87c-0a9125a3daef tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:57.182691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-13580ebb-1c64-4352-a87c-0a9125a3daef tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:57.183683 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-13580ebb-1c64-4352-a87c-0a9125a3daef tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:57.184124 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-13580ebb-1c64-4352-a87c-0a9125a3daef tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:57.313860 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-13580ebb-1c64-4352-a87c-0a9125a3daef tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:57.322007 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-13580ebb-1c64-4352-a87c-0a9125a3daef tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1315 microversion: 2.1 time: 0.151467 May 17 18:21:57.322588 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 541/1063] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:57 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:57.914314 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-735f2e76-b0e2-459b-8cc6-af66b7b71fe3 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:57.915100 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-735f2e76-b0e2-459b-8cc6-af66b7b71fe3 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:57.921080 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-735f2e76-b0e2-459b-8cc6-af66b7b71fe3 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:57.921536 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-735f2e76-b0e2-459b-8cc6-af66b7b71fe3 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:57.922303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-735f2e76-b0e2-459b-8cc6-af66b7b71fe3 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:57.922768 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-735f2e76-b0e2-459b-8cc6-af66b7b71fe3 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:58.054066 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-735f2e76-b0e2-459b-8cc6-af66b7b71fe3 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:58.061348 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-735f2e76-b0e2-459b-8cc6-af66b7b71fe3 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.151262 May 17 18:21:58.061904 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 523/1064] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:57 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:58.339405 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-680db38c-dca3-4589-9cdf-ce069bdcbc81 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:58.339994 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-680db38c-dca3-4589-9cdf-ce069bdcbc81 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:58.346630 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-680db38c-dca3-4589-9cdf-ce069bdcbc81 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:58.347087 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-680db38c-dca3-4589-9cdf-ce069bdcbc81 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:58.347855 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-680db38c-dca3-4589-9cdf-ce069bdcbc81 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:58.348289 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-680db38c-dca3-4589-9cdf-ce069bdcbc81 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:58.489622 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-680db38c-dca3-4589-9cdf-ce069bdcbc81 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:58.496812 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-680db38c-dca3-4589-9cdf-ce069bdcbc81 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1315 microversion: 2.1 time: 0.161874 May 17 18:21:58.497378 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 542/1065] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:58 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:59.078102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5ec551d8-f126-448a-8368-cfbe54b7d227 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:59.078678 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5ec551d8-f126-448a-8368-cfbe54b7d227 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:59.085144 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5ec551d8-f126-448a-8368-cfbe54b7d227 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.085596 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5ec551d8-f126-448a-8368-cfbe54b7d227 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.086361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5ec551d8-f126-448a-8368-cfbe54b7d227 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.086831 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5ec551d8-f126-448a-8368-cfbe54b7d227 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.217362 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5ec551d8-f126-448a-8368-cfbe54b7d227 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:59.225413 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5ec551d8-f126-448a-8368-cfbe54b7d227 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.151198 May 17 18:21:59.225976 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 524/1066] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:59 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:59.514752 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d27fef96-9125-46a8-801f-57d5aa0fed30 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:59.515391 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d27fef96-9125-46a8-801f-57d5aa0fed30 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:59.522451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d27fef96-9125-46a8-801f-57d5aa0fed30 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.522934 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d27fef96-9125-46a8-801f-57d5aa0fed30 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.523734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d27fef96-9125-46a8-801f-57d5aa0fed30 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.524175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d27fef96-9125-46a8-801f-57d5aa0fed30 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.650732 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d27fef96-9125-46a8-801f-57d5aa0fed30 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:59.657901 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d27fef96-9125-46a8-801f-57d5aa0fed30 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1464 microversion: 2.1 time: 0.147132 May 17 18:21:59.658566 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 543/1067] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:59 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:59.696108 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b7b562ba-ddd6-4f8c-a717-049771279108 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:59.696604 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b7b562ba-ddd6-4f8c-a717-049771279108 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:59.702376 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7b562ba-ddd6-4f8c-a717-049771279108 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.702855 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7b562ba-ddd6-4f8c-a717-049771279108 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.703614 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7b562ba-ddd6-4f8c-a717-049771279108 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.704048 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b7b562ba-ddd6-4f8c-a717-049771279108 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.729118 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b7b562ba-ddd6-4f8c-a717-049771279108 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Going to try to terminate instance {{(pid=117020) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:21:59.801837 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b7b562ba-ddd6-4f8c-a717-049771279108 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 204 len: 0 microversion: 2.1 time: 0.109253 May 17 18:21:59.802443 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 525/1068] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:21:59 2022] DELETE /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:21:59.811011 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-14d8c40b-c586-434e-a87d-094f0f61bcad tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:59.811636 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-14d8c40b-c586-434e-a87d-094f0f61bcad tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:59.818413 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-14d8c40b-c586-434e-a87d-094f0f61bcad tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.818890 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-14d8c40b-c586-434e-a87d-094f0f61bcad tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.819649 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-14d8c40b-c586-434e-a87d-094f0f61bcad tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.820087 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-14d8c40b-c586-434e-a87d-094f0f61bcad tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.945820 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-14d8c40b-c586-434e-a87d-094f0f61bcad tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:59.953112 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-14d8c40b-c586-434e-a87d-094f0f61bcad tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1470 microversion: 2.1 time: 0.145943 May 17 18:21:59.953678 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 544/1069] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:21:59 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:22:00.243701 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-cc4b98d9-f7ff-47c2-b24c-7cb51f862c36 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:00.244398 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-cc4b98d9-f7ff-47c2-b24c-7cb51f862c36 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:00.250736 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc4b98d9-f7ff-47c2-b24c-7cb51f862c36 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:00.251187 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc4b98d9-f7ff-47c2-b24c-7cb51f862c36 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:00.251947 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc4b98d9-f7ff-47c2-b24c-7cb51f862c36 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:00.253102 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cc4b98d9-f7ff-47c2-b24c-7cb51f862c36 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:00.382774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-cc4b98d9-f7ff-47c2-b24c-7cb51f862c36 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:00.389997 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-cc4b98d9-f7ff-47c2-b24c-7cb51f862c36 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.150647 May 17 18:22:00.390550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 526/1070] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:00 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:00.971670 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9d1f6626-ee1a-463f-ac2e-5eee788fc141 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:00.972396 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9d1f6626-ee1a-463f-ac2e-5eee788fc141 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:00.978991 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d1f6626-ee1a-463f-ac2e-5eee788fc141 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:00.979447 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d1f6626-ee1a-463f-ac2e-5eee788fc141 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:00.980222 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d1f6626-ee1a-463f-ac2e-5eee788fc141 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:00.980658 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9d1f6626-ee1a-463f-ac2e-5eee788fc141 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:01.106771 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9d1f6626-ee1a-463f-ac2e-5eee788fc141 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:01.114302 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9d1f6626-ee1a-463f-ac2e-5eee788fc141 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1470 microversion: 2.1 time: 0.147080 May 17 18:22:01.114990 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 545/1071] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:00 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:01.406608 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-18297f8e-1316-411d-920a-eb055e26e73a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:01.407144 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-18297f8e-1316-411d-920a-eb055e26e73a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:01.413495 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-18297f8e-1316-411d-920a-eb055e26e73a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:01.413941 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-18297f8e-1316-411d-920a-eb055e26e73a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:01.414741 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-18297f8e-1316-411d-920a-eb055e26e73a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:01.415183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-18297f8e-1316-411d-920a-eb055e26e73a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:01.550670 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-18297f8e-1316-411d-920a-eb055e26e73a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:01.558093 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-18297f8e-1316-411d-920a-eb055e26e73a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.155389 May 17 18:22:01.558693 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 527/1072] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:01 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:01.652419 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-49c95196-e8c7-4cd3-9dd3-8d9c44b88b64 req-eedf907a-125a-4b54-a3d4-5b23b3c7faf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f01a7cb-bd9d-453f-a26c-1b8356d7789e", "name": "network-vif-deleted", "tag": "cf03cfed-e063-49ac-9788-9de2bab164d5"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:01.661075 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-49c95196-e8c7-4cd3-9dd3-8d9c44b88b64 req-eedf907a-125a-4b54-a3d4-5b23b3c7faf1 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:01.661779 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-49c95196-e8c7-4cd3-9dd3-8d9c44b88b64 req-eedf907a-125a-4b54-a3d4-5b23b3c7faf1 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:01.680116 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-49c95196-e8c7-4cd3-9dd3-8d9c44b88b64 req-eedf907a-125a-4b54-a3d4-5b23b3c7faf1 service nova] Creating event network-vif-deleted:cf03cfed-e063-49ac-9788-9de2bab164d5 for instance 4f01a7cb-bd9d-453f-a26c-1b8356d7789e on hv-cinder-84130 May 17 18:22:01.685742 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-49c95196-e8c7-4cd3-9dd3-8d9c44b88b64 req-eedf907a-125a-4b54-a3d4-5b23b3c7faf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037367 May 17 18:22:01.686335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 546/1073] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:02.132018 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:02.132663 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:02.138945 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:02.139400 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:02.140168 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:02.140658 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:02.171906 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:02.172356 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:02.172804 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lazy-loading 'fault' on Instance uuid 4f01a7cb-bd9d-453f-a26c-1b8356d7789e {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:22:02.213548 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009134b036194923891214978273ac63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db856deb8834218acc26f7af5dfbe00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:02.220174 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8062ccbf-baf4-476f-a2f7-9e43db6a92bf tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 200 len: 1305 microversion: 2.1 time: 0.092707 May 17 18:22:02.220745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 528/1074] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:02 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:02.576809 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-46292d85-fac6-4b17-a1d0-c75eefebbefb tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:02.577420 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-46292d85-fac6-4b17-a1d0-c75eefebbefb tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:02.584296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46292d85-fac6-4b17-a1d0-c75eefebbefb tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:02.584754 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46292d85-fac6-4b17-a1d0-c75eefebbefb tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:02.585528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46292d85-fac6-4b17-a1d0-c75eefebbefb tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:02.585967 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46292d85-fac6-4b17-a1d0-c75eefebbefb tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:02.714724 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-46292d85-fac6-4b17-a1d0-c75eefebbefb tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:02.722316 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-46292d85-fac6-4b17-a1d0-c75eefebbefb tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.150172 May 17 18:22:02.722920 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 547/1075] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:02 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:03.236231 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bfd06099-9a3e-496e-9000-0a6055122275 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:03.237033 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-bfd06099-9a3e-496e-9000-0a6055122275 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] [instance: 4f01a7cb-bd9d-453f-a26c-1b8356d7789e] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:03.243519 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bfd06099-9a3e-496e-9000-0a6055122275 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:03.243977 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bfd06099-9a3e-496e-9000-0a6055122275 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:03.244742 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bfd06099-9a3e-496e-9000-0a6055122275 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:03.245180 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bfd06099-9a3e-496e-9000-0a6055122275 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:03.258590 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-bfd06099-9a3e-496e-9000-0a6055122275 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] HTTP exception thrown: Instance 4f01a7cb-bd9d-453f-a26c-1b8356d7789e could not be found. May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bfd06099-9a3e-496e-9000-0a6055122275 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Request method failure captured: May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e HTTP/1.1 May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-e4sen_hjbB1SPYKnfruza1B9BmX3NHYN8mOU9PzCda2nUFwK9WQMgkSo1tTAKaU8ZBZ3KhCLWQXjdByhXW_qVDlaU8uZqgt3jjdYNplOd0CiaiFktlMxyyL484Kjuv-TNi04EyZ_8durOQKOY93jZEmVQ4v748xB5VE3Qr6fd7iYQ May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 8db856deb8834218acc26f7af5dfbe00 May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-VolumesNegativeTest-29346116 May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:22:03.260222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8db856deb8834218acc26f7af5dfbe00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8db856deb8834218acc26f7af5dfbe00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8db856deb8834218acc26f7af5dfbe00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8db856deb8834218acc26f7af5dfbe00", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-VolumesNegativeTest-29346116 May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 8db856deb8834218acc26f7af5dfbe00 May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-VolumesNegativeTest-29346116 May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-VolumesNegativeTest-29346116-project May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 009134b036194923891214978273ac63 May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-VolumesNegativeTest-29346116-project May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 4f01a7cb-bd9d-453f-a26c-1b8356d7789e could not be found. May 17 18:22:03.261921 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '4f01a7cb-bd9d-453f-a26c-1b8356d7789e'} May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f01a7cb-bd9d-453f-a26c-1b8356d7789e could not be found. May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:22:03.263025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f01a7cb-bd9d-453f-a26c-1b8356d7789e could not be found. May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f01a7cb-bd9d-453f-a26c-1b8356d7789e could not be found. May 17 18:22:03.264659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:22:03.266207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bfd06099-9a3e-496e-9000-0a6055122275 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] Returning 404 to user: Instance 4f01a7cb-bd9d-453f-a26c-1b8356d7789e could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:22:03.266207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-bfd06099-9a3e-496e-9000-0a6055122275 tempest-VolumesNegativeTest-29346116 tempest-VolumesNegativeTest-29346116-project] 10.222.0.25 "GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e" status: 404 len: 111 microversion: 2.1 time: 0.029230 May 17 18:22:03.266207 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 529/1076] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:03 2022] GET /compute/v2.1/servers/4f01a7cb-bd9d-453f-a26c-1b8356d7789e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:22:03.738426 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-98f9b354-898e-4fd1-add4-cd32f2844c43 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:03.739075 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-98f9b354-898e-4fd1-add4-cd32f2844c43 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:03.745359 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-98f9b354-898e-4fd1-add4-cd32f2844c43 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:03.745811 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-98f9b354-898e-4fd1-add4-cd32f2844c43 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:03.749490 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-98f9b354-898e-4fd1-add4-cd32f2844c43 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:03.749490 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-98f9b354-898e-4fd1-add4-cd32f2844c43 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:03.885253 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-98f9b354-898e-4fd1-add4-cd32f2844c43 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:03.892624 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-98f9b354-898e-4fd1-add4-cd32f2844c43 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.158099 May 17 18:22:03.893713 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 548/1077] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:03 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:04.911896 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5ad8601d-eaf3-4768-a704-7d9105f2e073 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:04.912525 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5ad8601d-eaf3-4768-a704-7d9105f2e073 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:04.923566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5ad8601d-eaf3-4768-a704-7d9105f2e073 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:04.924109 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5ad8601d-eaf3-4768-a704-7d9105f2e073 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:04.925583 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5ad8601d-eaf3-4768-a704-7d9105f2e073 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:04.926026 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5ad8601d-eaf3-4768-a704-7d9105f2e073 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:05.062519 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5ad8601d-eaf3-4768-a704-7d9105f2e073 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:05.070848 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5ad8601d-eaf3-4768-a704-7d9105f2e073 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.164264 May 17 18:22:05.071355 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 530/1078] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:04 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:06.088578 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6699534a-cd9f-477a-b575-0773068dbee8 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:06.089356 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6699534a-cd9f-477a-b575-0773068dbee8 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:06.095850 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6699534a-cd9f-477a-b575-0773068dbee8 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:06.096302 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6699534a-cd9f-477a-b575-0773068dbee8 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:06.097802 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6699534a-cd9f-477a-b575-0773068dbee8 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:06.098326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6699534a-cd9f-477a-b575-0773068dbee8 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:06.237825 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6699534a-cd9f-477a-b575-0773068dbee8 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:06.245231 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6699534a-cd9f-477a-b575-0773068dbee8 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.161018 May 17 18:22:06.245793 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 549/1079] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:06 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:07.261395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-97293b23-3303-40e7-bfe2-968ddf38a263 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:07.262109 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-97293b23-3303-40e7-bfe2-968ddf38a263 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:07.268384 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-97293b23-3303-40e7-bfe2-968ddf38a263 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:07.269458 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-97293b23-3303-40e7-bfe2-968ddf38a263 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:07.270270 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-97293b23-3303-40e7-bfe2-968ddf38a263 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:07.270739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-97293b23-3303-40e7-bfe2-968ddf38a263 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:07.400122 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-97293b23-3303-40e7-bfe2-968ddf38a263 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:07.407386 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-97293b23-3303-40e7-bfe2-968ddf38a263 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.149763 May 17 18:22:07.407948 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 531/1080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:07 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:08.426360 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-15a8cd64-fa51-4db5-8870-a7cdf449df5e tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:08.427224 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-15a8cd64-fa51-4db5-8870-a7cdf449df5e tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:08.436053 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-15a8cd64-fa51-4db5-8870-a7cdf449df5e tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:08.436506 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-15a8cd64-fa51-4db5-8870-a7cdf449df5e tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:08.437291 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-15a8cd64-fa51-4db5-8870-a7cdf449df5e tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:08.437875 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-15a8cd64-fa51-4db5-8870-a7cdf449df5e tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:08.549235 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-8983b79b-ef4a-40c5-8414-9fc2a6aa201e req-4f4f36ec-53fc-4997-b450-212fd7cc93b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d", "name": "network-vif-plugged", "status": "completed", "tag": "8cd46e6c-881d-4940-bcd6-fc6a73179551"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:08.558850 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-8983b79b-ef4a-40c5-8414-9fc2a6aa201e req-4f4f36ec-53fc-4997-b450-212fd7cc93b0 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:08.559337 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-8983b79b-ef4a-40c5-8414-9fc2a6aa201e req-4f4f36ec-53fc-4997-b450-212fd7cc93b0 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:08.571927 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-8983b79b-ef4a-40c5-8414-9fc2a6aa201e req-4f4f36ec-53fc-4997-b450-212fd7cc93b0 service nova] Creating event network-vif-plugged:8cd46e6c-881d-4940-bcd6-fc6a73179551 for instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d on hv-cinder-84130 May 17 18:22:08.576996 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-8983b79b-ef4a-40c5-8414-9fc2a6aa201e req-4f4f36ec-53fc-4997-b450-212fd7cc93b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032291 May 17 18:22:08.577590 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 532/1081] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:22:08.595667 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-15a8cd64-fa51-4db5-8870-a7cdf449df5e tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:08.605281 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-15a8cd64-fa51-4db5-8870-a7cdf449df5e tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.184710 May 17 18:22:08.606356 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 550/1082] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:08 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:09.624590 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-178804d6-5ffa-43be-866a-76937a10f003 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:09.625443 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-178804d6-5ffa-43be-866a-76937a10f003 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:09.633854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-178804d6-5ffa-43be-866a-76937a10f003 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:09.634315 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-178804d6-5ffa-43be-866a-76937a10f003 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:09.635169 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-178804d6-5ffa-43be-866a-76937a10f003 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:09.635612 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-178804d6-5ffa-43be-866a-76937a10f003 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:09.806113 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-178804d6-5ffa-43be-866a-76937a10f003 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:09.813594 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-178804d6-5ffa-43be-866a-76937a10f003 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.194390 May 17 18:22:09.814166 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 533/1083] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:09 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:10.830885 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6dc891f4-372b-4a67-a7ce-99691c3e8676 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:10.832024 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-6dc891f4-372b-4a67-a7ce-99691c3e8676 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:10.838662 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6dc891f4-372b-4a67-a7ce-99691c3e8676 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:10.839113 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6dc891f4-372b-4a67-a7ce-99691c3e8676 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:10.839880 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6dc891f4-372b-4a67-a7ce-99691c3e8676 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:10.840331 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-6dc891f4-372b-4a67-a7ce-99691c3e8676 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:10.970739 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-6dc891f4-372b-4a67-a7ce-99691c3e8676 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:10.978855 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6dc891f4-372b-4a67-a7ce-99691c3e8676 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.151835 May 17 18:22:10.979460 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 551/1084] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:10 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:11.995500 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-706e08d1-66d4-443b-b413-839aaa64857c tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:11.996047 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-706e08d1-66d4-443b-b413-839aaa64857c tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:12.002650 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-706e08d1-66d4-443b-b413-839aaa64857c tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:12.003364 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-706e08d1-66d4-443b-b413-839aaa64857c tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:12.004152 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-706e08d1-66d4-443b-b413-839aaa64857c tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:12.004594 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-706e08d1-66d4-443b-b413-839aaa64857c tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:12.136199 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-706e08d1-66d4-443b-b413-839aaa64857c tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:12.143437 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-706e08d1-66d4-443b-b413-839aaa64857c tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1260 microversion: 2.1 time: 0.151913 May 17 18:22:12.144523 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 534/1085] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:11 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:13.161326 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-75a8f03e-04e7-401d-814b-a638f5dcd1fe tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:13.161873 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-75a8f03e-04e7-401d-814b-a638f5dcd1fe tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:13.168252 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-75a8f03e-04e7-401d-814b-a638f5dcd1fe tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:13.168704 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-75a8f03e-04e7-401d-814b-a638f5dcd1fe tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:13.169518 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-75a8f03e-04e7-401d-814b-a638f5dcd1fe tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:13.169956 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-75a8f03e-04e7-401d-814b-a638f5dcd1fe tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:13.299542 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-75a8f03e-04e7-401d-814b-a638f5dcd1fe tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:13.307756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-75a8f03e-04e7-401d-814b-a638f5dcd1fe tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1443 microversion: 2.1 time: 0.151121 May 17 18:22:13.308340 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 552/1086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:13 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:13.324177 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-336e81ba-7f78-4767-8b4f-a9411b780f02 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:13.324818 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-336e81ba-7f78-4767-8b4f-a9411b780f02 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:13.331424 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-336e81ba-7f78-4767-8b4f-a9411b780f02 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:13.332022 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-336e81ba-7f78-4767-8b4f-a9411b780f02 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:13.332792 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-336e81ba-7f78-4767-8b4f-a9411b780f02 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:13.333233 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-336e81ba-7f78-4767-8b4f-a9411b780f02 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:13.458882 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-336e81ba-7f78-4767-8b4f-a9411b780f02 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:13.466209 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-336e81ba-7f78-4767-8b4f-a9411b780f02 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1443 microversion: 2.1 time: 0.146017 May 17 18:22:13.466815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 535/1087] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:13 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1443 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:15.414845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-2173b556-c308-4309-805d-daaa3507f8ed req-dbead18b-522c-41be-8312-e67b7a2c29ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d", "tag": "8cd46e6c-881d-4940-bcd6-fc6a73179551"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:15.423099 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-2173b556-c308-4309-805d-daaa3507f8ed req-dbead18b-522c-41be-8312-e67b7a2c29ec service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:15.423538 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-2173b556-c308-4309-805d-daaa3507f8ed req-dbead18b-522c-41be-8312-e67b7a2c29ec service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:15.434349 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-2173b556-c308-4309-805d-daaa3507f8ed req-dbead18b-522c-41be-8312-e67b7a2c29ec service nova] Creating event network-changed:8cd46e6c-881d-4940-bcd6-fc6a73179551 for instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d on hv-cinder-84130 May 17 18:22:15.439563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-2173b556-c308-4309-805d-daaa3507f8ed req-dbead18b-522c-41be-8312-e67b7a2c29ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028640 May 17 18:22:15.440382 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 553/1088] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:34.463500 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6948f0d5-3c15-4787-88a3-84a2d82ca177 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Action: 'create', calling method: .version_select at 0x7f74abc9a940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-718503433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmqGePU06qk4NzEJxtEZkB3t2pnIWBj2WGYVpPBLLl6rqc2KMbtf0bR8CpICBsx0OV2P6VOKXGMPk6zU2F5QPjQJKpa2NZdrZgy9Ju3L4G+615wSKjHzpgr+CwIEDqHvQ=="}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:34.477818 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-6948f0d5-3c15-4787-88a3-84a2d82ca177 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Getting quotas for project af75981c6f0c44168aa9123430944fd2. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:22:34.481488 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-6948f0d5-3c15-4787-88a3-84a2d82ca177 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Getting quotas for user 91d999e39c144d04ac8c6ca5a4660d24 and project af75981c6f0c44168aa9123430944fd2. Resources: {'key_pairs'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:22:34.504075 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6948f0d5-3c15-4787-88a3-84a2d82ca177 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.207158 May 17 18:22:34.504739 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 536/1089] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 17 18:22:34 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:50.946792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-868144700", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-718503433", "security_groups": [{"name": "tempest-secgroup-smoke-1753324118"}], "block_device_mapping_v2": [{"uuid": "74efecfb-f1ac-411f-b64d-83a73a228761", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd052ceb-f845-4dfa-9472-80cdd5ad993a"}]}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:51.152942 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.network.neutron [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] validate_networks() for [('fd052ceb-f845-4dfa-9472-80cdd5ad993a', None, None, None, None, None)] {{(pid=117021) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:22:51.760343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Flavor limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:22:51.760767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Image limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:22:51.761255 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Flavor pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:22:51.761662 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Image pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:22:51.762274 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:22:51.771964 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:51.772504 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:51.773441 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:51.773999 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:51.790664 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Getting quotas for project af75981c6f0c44168aa9123430944fd2. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:22:51.794678 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Getting quotas for user 91d999e39c144d04ac8c6ca5a4660d24 and project af75981c6f0c44168aa9123430944fd2. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:22:51.849914 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Going to run 1 instances... {{(pid=117021) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:22:51.852090 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74efecfb-f1ac-411f-b64d-83a73a228761',volume_size=None,volume_type=None)] {{(pid=117021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:22:51.973910 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e9d29cf8-f541-45eb-83de-a21094ae9e06 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.032379 May 17 18:22:51.975354 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 554/1090] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:22:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:22:51.985417 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-abed7509-4434-4a6b-bdb4-efe54bf910c1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:51.986151 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-abed7509-4434-4a6b-bdb4-efe54bf910c1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:52.044748 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-abed7509-4434-4a6b-bdb4-efe54bf910c1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:52.051626 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-abed7509-4434-4a6b-bdb4-efe54bf910c1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1093 microversion: 2.1 time: 0.070643 May 17 18:22:52.052269 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 537/1091] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:51 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:53.070877 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f5bafe58-9cdd-4bcb-a4d7-ba3c5ce1aa5f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:53.071514 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f5bafe58-9cdd-4bcb-a4d7-ba3c5ce1aa5f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:53.077897 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f5bafe58-9cdd-4bcb-a4d7-ba3c5ce1aa5f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:53.078604 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f5bafe58-9cdd-4bcb-a4d7-ba3c5ce1aa5f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:53.079545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f5bafe58-9cdd-4bcb-a4d7-ba3c5ce1aa5f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:53.079995 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f5bafe58-9cdd-4bcb-a4d7-ba3c5ce1aa5f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:53.142601 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f5bafe58-9cdd-4bcb-a4d7-ba3c5ce1aa5f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:53.150792 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f5bafe58-9cdd-4bcb-a4d7-ba3c5ce1aa5f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1209 microversion: 2.1 time: 0.085322 May 17 18:22:53.151372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 555/1092] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:53 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:54.169318 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e28920b8-78f0-43d8-b6e8-5067b483efc2 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:54.170814 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e28920b8-78f0-43d8-b6e8-5067b483efc2 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:54.177636 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e28920b8-78f0-43d8-b6e8-5067b483efc2 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:54.178844 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e28920b8-78f0-43d8-b6e8-5067b483efc2 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:54.179675 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e28920b8-78f0-43d8-b6e8-5067b483efc2 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:54.180127 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e28920b8-78f0-43d8-b6e8-5067b483efc2 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:54.313901 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e28920b8-78f0-43d8-b6e8-5067b483efc2 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:54.322286 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e28920b8-78f0-43d8-b6e8-5067b483efc2 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.156858 May 17 18:22:54.322892 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 538/1093] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:54 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:22:54.612089 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-9d86bb26-b3dd-4860-92da-18ba3d8c2ef3 req-9b51296b-7e5d-4aab-b8be-2b19d76b2a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81a563a-5441-4226-b0af-8e83d90e64ac", "tag": "cc2e0d37-6a6e-407e-9504-4e11aee8a14e"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:54.621825 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-9d86bb26-b3dd-4860-92da-18ba3d8c2ef3 req-9b51296b-7e5d-4aab-b8be-2b19d76b2a8f service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:54.622868 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-9d86bb26-b3dd-4860-92da-18ba3d8c2ef3 req-9b51296b-7e5d-4aab-b8be-2b19d76b2a8f service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:54.645850 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-9d86bb26-b3dd-4860-92da-18ba3d8c2ef3 req-9b51296b-7e5d-4aab-b8be-2b19d76b2a8f service nova] Creating event network-changed:cc2e0d37-6a6e-407e-9504-4e11aee8a14e for instance d81a563a-5441-4226-b0af-8e83d90e64ac on hv-cinder-84130 May 17 18:22:54.651512 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-9d86bb26-b3dd-4860-92da-18ba3d8c2ef3 req-9b51296b-7e5d-4aab-b8be-2b19d76b2a8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043691 May 17 18:22:54.652345 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 556/1094] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:55.339830 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6b455095-1cf7-4b8b-b27e-c8103a135085 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:55.340715 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6b455095-1cf7-4b8b-b27e-c8103a135085 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:55.347138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6b455095-1cf7-4b8b-b27e-c8103a135085 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:55.347594 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6b455095-1cf7-4b8b-b27e-c8103a135085 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:55.348368 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6b455095-1cf7-4b8b-b27e-c8103a135085 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:55.348811 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6b455095-1cf7-4b8b-b27e-c8103a135085 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:55.481033 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6b455095-1cf7-4b8b-b27e-c8103a135085 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:55.488361 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6b455095-1cf7-4b8b-b27e-c8103a135085 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.152364 May 17 18:22:55.489012 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 539/1095] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:55 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:22:56.506149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e300ff6b-ac90-4888-b7ad-7688e9623e2f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:56.506875 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e300ff6b-ac90-4888-b7ad-7688e9623e2f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:56.513037 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e300ff6b-ac90-4888-b7ad-7688e9623e2f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:56.513496 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e300ff6b-ac90-4888-b7ad-7688e9623e2f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:56.514257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e300ff6b-ac90-4888-b7ad-7688e9623e2f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:56.514734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e300ff6b-ac90-4888-b7ad-7688e9623e2f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:56.646212 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e300ff6b-ac90-4888-b7ad-7688e9623e2f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:56.654053 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e300ff6b-ac90-4888-b7ad-7688e9623e2f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.152598 May 17 18:22:56.654639 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 557/1096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:56 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:57.670966 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-967cf7f8-7fec-4ecd-a2fc-cb37c4d02401 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:57.671616 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-967cf7f8-7fec-4ecd-a2fc-cb37c4d02401 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:57.678696 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-967cf7f8-7fec-4ecd-a2fc-cb37c4d02401 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:57.679161 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-967cf7f8-7fec-4ecd-a2fc-cb37c4d02401 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:57.679937 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-967cf7f8-7fec-4ecd-a2fc-cb37c4d02401 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:57.680383 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-967cf7f8-7fec-4ecd-a2fc-cb37c4d02401 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:57.903677 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-967cf7f8-7fec-4ecd-a2fc-cb37c4d02401 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:57.910983 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-967cf7f8-7fec-4ecd-a2fc-cb37c4d02401 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.243949 May 17 18:22:57.911537 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 540/1097] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:57 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:58.928620 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b4db41f0-62b8-4c95-9ed6-46ff1f0333cd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:58.929264 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b4db41f0-62b8-4c95-9ed6-46ff1f0333cd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:58.936417 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b4db41f0-62b8-4c95-9ed6-46ff1f0333cd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:58.936868 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b4db41f0-62b8-4c95-9ed6-46ff1f0333cd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:58.937633 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b4db41f0-62b8-4c95-9ed6-46ff1f0333cd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:58.938068 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b4db41f0-62b8-4c95-9ed6-46ff1f0333cd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:59.070234 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b4db41f0-62b8-4c95-9ed6-46ff1f0333cd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:59.077564 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b4db41f0-62b8-4c95-9ed6-46ff1f0333cd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.153131 May 17 18:22:59.078138 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 558/1098] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:22:58 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:00.094272 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2edaf955-48ac-4804-903f-a8da8e2b5b85 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:00.094911 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2edaf955-48ac-4804-903f-a8da8e2b5b85 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:00.101952 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2edaf955-48ac-4804-903f-a8da8e2b5b85 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:00.102404 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2edaf955-48ac-4804-903f-a8da8e2b5b85 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:00.103200 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2edaf955-48ac-4804-903f-a8da8e2b5b85 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:00.103637 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2edaf955-48ac-4804-903f-a8da8e2b5b85 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:00.232688 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2edaf955-48ac-4804-903f-a8da8e2b5b85 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:00.239963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2edaf955-48ac-4804-903f-a8da8e2b5b85 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.149467 May 17 18:23:00.240579 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 541/1099] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:23:00 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:01.256690 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-20741f8d-a9be-4cca-9bd2-7de551faf190 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:01.257301 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-20741f8d-a9be-4cca-9bd2-7de551faf190 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:01.263708 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-20741f8d-a9be-4cca-9bd2-7de551faf190 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:01.264162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-20741f8d-a9be-4cca-9bd2-7de551faf190 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:01.264932 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-20741f8d-a9be-4cca-9bd2-7de551faf190 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:01.265372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-20741f8d-a9be-4cca-9bd2-7de551faf190 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:01.396921 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-20741f8d-a9be-4cca-9bd2-7de551faf190 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:01.404152 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-20741f8d-a9be-4cca-9bd2-7de551faf190 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.151381 May 17 18:23:01.404706 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 559/1100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:23:01 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:02.421256 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-03ab051f-14b6-423f-9104-ae9bb0e031fd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:02.421877 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-03ab051f-14b6-423f-9104-ae9bb0e031fd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:02.429181 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-03ab051f-14b6-423f-9104-ae9bb0e031fd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:02.429644 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-03ab051f-14b6-423f-9104-ae9bb0e031fd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:02.430421 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-03ab051f-14b6-423f-9104-ae9bb0e031fd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:02.430897 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-03ab051f-14b6-423f-9104-ae9bb0e031fd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:02.559733 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-03ab051f-14b6-423f-9104-ae9bb0e031fd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:02.566946 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-03ab051f-14b6-423f-9104-ae9bb0e031fd tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.149589 May 17 18:23:02.567504 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 542/1101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:23:02 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:03.584555 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-35f34fd8-7b1d-4e6f-9100-f4f832ad3b44 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:03.585113 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-35f34fd8-7b1d-4e6f-9100-f4f832ad3b44 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:03.591504 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35f34fd8-7b1d-4e6f-9100-f4f832ad3b44 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:03.591955 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35f34fd8-7b1d-4e6f-9100-f4f832ad3b44 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:03.592712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35f34fd8-7b1d-4e6f-9100-f4f832ad3b44 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:03.593147 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-35f34fd8-7b1d-4e6f-9100-f4f832ad3b44 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:03.724064 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-35f34fd8-7b1d-4e6f-9100-f4f832ad3b44 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:03.731434 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-35f34fd8-7b1d-4e6f-9100-f4f832ad3b44 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.151434 May 17 18:23:03.731998 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 560/1102] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:23:03 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:04.748878 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2607a095-405e-49f5-b29b-cfae26be2e75 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:04.749592 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2607a095-405e-49f5-b29b-cfae26be2e75 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:04.756054 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2607a095-405e-49f5-b29b-cfae26be2e75 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.756505 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2607a095-405e-49f5-b29b-cfae26be2e75 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.757274 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2607a095-405e-49f5-b29b-cfae26be2e75 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.757714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2607a095-405e-49f5-b29b-cfae26be2e75 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.893287 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2607a095-405e-49f5-b29b-cfae26be2e75 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:04.903397 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2607a095-405e-49f5-b29b-cfae26be2e75 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.158211 May 17 18:23:04.910648 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 543/1103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:23:04 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:04.922510 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-13825e97-5973-4ef6-9652-2d2b1de9bb7c req-07540874-1081-4713-a88f-55eefdf4ae56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81a563a-5441-4226-b0af-8e83d90e64ac", "name": "network-vif-plugged", "status": "completed", "tag": "cc2e0d37-6a6e-407e-9504-4e11aee8a14e"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:04.928980 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-13825e97-5973-4ef6-9652-2d2b1de9bb7c req-07540874-1081-4713-a88f-55eefdf4ae56 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.929487 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-13825e97-5973-4ef6-9652-2d2b1de9bb7c req-07540874-1081-4713-a88f-55eefdf4ae56 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.942763 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-13825e97-5973-4ef6-9652-2d2b1de9bb7c req-07540874-1081-4713-a88f-55eefdf4ae56 service nova] Creating event network-vif-plugged:cc2e0d37-6a6e-407e-9504-4e11aee8a14e for instance d81a563a-5441-4226-b0af-8e83d90e64ac on hv-cinder-84130 May 17 18:23:04.949192 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-13825e97-5973-4ef6-9652-2d2b1de9bb7c req-07540874-1081-4713-a88f-55eefdf4ae56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033718 May 17 18:23:04.950109 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 561/1104] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:23:05.920898 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-b17fd73f-b515-430f-ac6b-e11b56e4dbba tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:05.921503 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-b17fd73f-b515-430f-ac6b-e11b56e4dbba tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:05.928001 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b17fd73f-b515-430f-ac6b-e11b56e4dbba tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:05.928475 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b17fd73f-b515-430f-ac6b-e11b56e4dbba tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:05.929242 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b17fd73f-b515-430f-ac6b-e11b56e4dbba tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:05.929684 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-b17fd73f-b515-430f-ac6b-e11b56e4dbba tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:06.059466 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-b17fd73f-b515-430f-ac6b-e11b56e4dbba tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:06.066871 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-b17fd73f-b515-430f-ac6b-e11b56e4dbba tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1265 microversion: 2.1 time: 0.149759 May 17 18:23:06.067433 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 544/1105] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:23:05 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:07.085294 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-2b3c4ee6-358d-4400-8642-371ab81f66ea tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:07.085984 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-2b3c4ee6-358d-4400-8642-371ab81f66ea tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:07.092113 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2b3c4ee6-358d-4400-8642-371ab81f66ea tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:07.092563 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2b3c4ee6-358d-4400-8642-371ab81f66ea tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:07.093322 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2b3c4ee6-358d-4400-8642-371ab81f66ea tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:07.093757 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-2b3c4ee6-358d-4400-8642-371ab81f66ea tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:07.225652 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-2b3c4ee6-358d-4400-8642-371ab81f66ea tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:07.233019 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-2b3c4ee6-358d-4400-8642-371ab81f66ea tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1451 microversion: 2.1 time: 0.152492 May 17 18:23:07.233592 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 562/1106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:23:07 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:07.249132 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-39f7e2c8-124b-4830-90e1-a64f778510cc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:07.249744 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-39f7e2c8-124b-4830-90e1-a64f778510cc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:07.256581 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39f7e2c8-124b-4830-90e1-a64f778510cc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:07.257034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39f7e2c8-124b-4830-90e1-a64f778510cc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:07.257805 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39f7e2c8-124b-4830-90e1-a64f778510cc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:07.258244 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-39f7e2c8-124b-4830-90e1-a64f778510cc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:07.387937 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-39f7e2c8-124b-4830-90e1-a64f778510cc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:07.397146 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-39f7e2c8-124b-4830-90e1-a64f778510cc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1451 microversion: 2.1 time: 0.151775 May 17 18:23:07.397711 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 545/1107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:23:07 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:09.249335 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-ed5ad6c2-bb4f-4243-80f6-379209d0b389 req-aa273e23-9612-4220-b67d-8fe6507e966c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81a563a-5441-4226-b0af-8e83d90e64ac", "tag": "cc2e0d37-6a6e-407e-9504-4e11aee8a14e"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:09.258684 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-ed5ad6c2-bb4f-4243-80f6-379209d0b389 req-aa273e23-9612-4220-b67d-8fe6507e966c service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:09.259192 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-ed5ad6c2-bb4f-4243-80f6-379209d0b389 req-aa273e23-9612-4220-b67d-8fe6507e966c service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:09.270311 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-ed5ad6c2-bb4f-4243-80f6-379209d0b389 req-aa273e23-9612-4220-b67d-8fe6507e966c service nova] Creating event network-changed:cc2e0d37-6a6e-407e-9504-4e11aee8a14e for instance d81a563a-5441-4226-b0af-8e83d90e64ac on hv-cinder-84130 May 17 18:23:09.275765 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-ed5ad6c2-bb4f-4243-80f6-379209d0b389 req-aa273e23-9612-4220-b67d-8fe6507e966c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030117 May 17 18:23:09.276522 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 563/1108] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:24:11.364824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-12f8e2be-fa77-4f4c-83db-0d27989b081f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:11.365437 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-12f8e2be-fa77-4f4c-83db-0d27989b081f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:11.371234 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-12f8e2be-fa77-4f4c-83db-0d27989b081f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:11.371681 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-12f8e2be-fa77-4f4c-83db-0d27989b081f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:11.372444 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-12f8e2be-fa77-4f4c-83db-0d27989b081f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:11.372879 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-12f8e2be-fa77-4f4c-83db-0d27989b081f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:11.394780 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.objects.instance [None req-12f8e2be-fa77-4f4c-83db-0d27989b081f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lazy-loading 'flavor' on Instance uuid 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d {{(pid=117020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:24:11.465978 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-12f8e2be-fa77-4f4c-83db-0d27989b081f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "POST /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d/action" status: 202 len: 0 microversion: 2.1 time: 0.106150 May 17 18:24:11.466750 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 546/1109] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:24:11 2022] POST /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:24:11.477432 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c8ee05a6-0ac3-43ce-a128-b3ede4f5f430 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:11.478137 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c8ee05a6-0ac3-43ce-a128-b3ede4f5f430 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:11.484572 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c8ee05a6-0ac3-43ce-a128-b3ede4f5f430 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:11.485034 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c8ee05a6-0ac3-43ce-a128-b3ede4f5f430 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:11.485816 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c8ee05a6-0ac3-43ce-a128-b3ede4f5f430 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:11.486262 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c8ee05a6-0ac3-43ce-a128-b3ede4f5f430 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:11.621422 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c8ee05a6-0ac3-43ce-a128-b3ede4f5f430 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:11.628785 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c8ee05a6-0ac3-43ce-a128-b3ede4f5f430 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.157611 May 17 18:24:11.629348 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 564/1110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:11 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:12.647751 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-84d44d3a-44d6-4e05-bdaf-7c8221a8a153 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:12.648450 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-84d44d3a-44d6-4e05-bdaf-7c8221a8a153 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:12.655231 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-84d44d3a-44d6-4e05-bdaf-7c8221a8a153 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:12.655681 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-84d44d3a-44d6-4e05-bdaf-7c8221a8a153 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:12.656439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-84d44d3a-44d6-4e05-bdaf-7c8221a8a153 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:12.656903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-84d44d3a-44d6-4e05-bdaf-7c8221a8a153 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:12.785258 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-84d44d3a-44d6-4e05-bdaf-7c8221a8a153 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:12.793641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-84d44d3a-44d6-4e05-bdaf-7c8221a8a153 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.150910 May 17 18:24:12.794208 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 547/1111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:12 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:13.810451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-52dbf21c-1b68-491b-bd55-2b7534c5443f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:13.811114 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-52dbf21c-1b68-491b-bd55-2b7534c5443f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:13.817454 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-52dbf21c-1b68-491b-bd55-2b7534c5443f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:13.817906 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-52dbf21c-1b68-491b-bd55-2b7534c5443f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:13.818943 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-52dbf21c-1b68-491b-bd55-2b7534c5443f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:13.819371 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-52dbf21c-1b68-491b-bd55-2b7534c5443f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:13.965845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-52dbf21c-1b68-491b-bd55-2b7534c5443f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:13.973621 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-52dbf21c-1b68-491b-bd55-2b7534c5443f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.167010 May 17 18:24:13.974204 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 565/1112] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:13 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:14.990433 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7ec7d05c-653a-4384-9022-df8b3138e281 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:14.991571 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7ec7d05c-653a-4384-9022-df8b3138e281 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:14.997859 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7ec7d05c-653a-4384-9022-df8b3138e281 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:14.998308 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7ec7d05c-653a-4384-9022-df8b3138e281 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:14.999108 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7ec7d05c-653a-4384-9022-df8b3138e281 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:14.999545 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7ec7d05c-653a-4384-9022-df8b3138e281 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:15.129749 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7ec7d05c-653a-4384-9022-df8b3138e281 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:15.137673 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7ec7d05c-653a-4384-9022-df8b3138e281 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.151095 May 17 18:24:15.138167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 548/1113] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:14 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:16.154728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5dd1e558-2734-41b6-a682-0d9e94d50bfa tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:16.155343 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5dd1e558-2734-41b6-a682-0d9e94d50bfa tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:16.161607 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dd1e558-2734-41b6-a682-0d9e94d50bfa tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:16.162062 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dd1e558-2734-41b6-a682-0d9e94d50bfa tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:16.163489 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dd1e558-2734-41b6-a682-0d9e94d50bfa tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:16.163928 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dd1e558-2734-41b6-a682-0d9e94d50bfa tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:16.292921 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5dd1e558-2734-41b6-a682-0d9e94d50bfa tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:16.300209 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5dd1e558-2734-41b6-a682-0d9e94d50bfa tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.149465 May 17 18:24:16.300779 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 566/1114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:16 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:17.318356 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-1464f220-e3bf-480a-aaa6-72ef4039072b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:17.320391 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-1464f220-e3bf-480a-aaa6-72ef4039072b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:17.326786 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1464f220-e3bf-480a-aaa6-72ef4039072b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:17.327247 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1464f220-e3bf-480a-aaa6-72ef4039072b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:17.328027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1464f220-e3bf-480a-aaa6-72ef4039072b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:17.328473 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-1464f220-e3bf-480a-aaa6-72ef4039072b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:17.459032 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-1464f220-e3bf-480a-aaa6-72ef4039072b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:17.466487 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-1464f220-e3bf-480a-aaa6-72ef4039072b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.152031 May 17 18:24:17.467094 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 549/1115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:17 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:18.484334 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-c191801c-2938-4fe6-8d07-55646adb7487 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:18.484951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-c191801c-2938-4fe6-8d07-55646adb7487 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:18.491355 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c191801c-2938-4fe6-8d07-55646adb7487 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:18.491809 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c191801c-2938-4fe6-8d07-55646adb7487 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:18.492586 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c191801c-2938-4fe6-8d07-55646adb7487 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:18.493023 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-c191801c-2938-4fe6-8d07-55646adb7487 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:18.624481 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-c191801c-2938-4fe6-8d07-55646adb7487 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:18.632457 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-c191801c-2938-4fe6-8d07-55646adb7487 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.152188 May 17 18:24:18.633016 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 567/1116] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:18 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:19.649089 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6fccd250-0055-4d64-9b77-21e17dfecff4 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:19.649705 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6fccd250-0055-4d64-9b77-21e17dfecff4 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:19.656049 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6fccd250-0055-4d64-9b77-21e17dfecff4 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:19.656499 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6fccd250-0055-4d64-9b77-21e17dfecff4 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:19.657266 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6fccd250-0055-4d64-9b77-21e17dfecff4 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:19.657704 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6fccd250-0055-4d64-9b77-21e17dfecff4 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:19.788750 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6fccd250-0055-4d64-9b77-21e17dfecff4 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:19.795991 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6fccd250-0055-4d64-9b77-21e17dfecff4 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.151497 May 17 18:24:19.796582 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 550/1117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:19 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:24:20.813046 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5dedd452-93a8-4272-81d1-8ed303409fbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:20.813746 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5dedd452-93a8-4272-81d1-8ed303409fbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:20.821286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dedd452-93a8-4272-81d1-8ed303409fbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:20.821737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dedd452-93a8-4272-81d1-8ed303409fbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:20.822500 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dedd452-93a8-4272-81d1-8ed303409fbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:20.822965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5dedd452-93a8-4272-81d1-8ed303409fbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:20.953037 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5dedd452-93a8-4272-81d1-8ed303409fbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:20.960451 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5dedd452-93a8-4272-81d1-8ed303409fbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.151295 May 17 18:24:20.961008 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 568/1118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:20 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:21.977778 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8e1456e2-f956-425d-a21d-8c6583ad1cbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:21.978401 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-8e1456e2-f956-425d-a21d-8c6583ad1cbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:21.985112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8e1456e2-f956-425d-a21d-8c6583ad1cbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:21.985566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8e1456e2-f956-425d-a21d-8c6583ad1cbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:21.986345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8e1456e2-f956-425d-a21d-8c6583ad1cbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:21.986814 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-8e1456e2-f956-425d-a21d-8c6583ad1cbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:22.116769 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-8e1456e2-f956-425d-a21d-8c6583ad1cbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:22.124550 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8e1456e2-f956-425d-a21d-8c6583ad1cbf tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.151241 May 17 18:24:22.125152 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 551/1119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:21 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:23.142183 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7f4f6395-1725-41d1-ab83-0410ddbb88de tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:23.142769 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7f4f6395-1725-41d1-ab83-0410ddbb88de tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:23.150497 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f4f6395-1725-41d1-ab83-0410ddbb88de tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:23.150979 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f4f6395-1725-41d1-ab83-0410ddbb88de tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:23.151751 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f4f6395-1725-41d1-ab83-0410ddbb88de tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:23.152189 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7f4f6395-1725-41d1-ab83-0410ddbb88de tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:23.283245 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7f4f6395-1725-41d1-ab83-0410ddbb88de tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:23.291269 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7f4f6395-1725-41d1-ab83-0410ddbb88de tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.153036 May 17 18:24:23.291836 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 569/1120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:23 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:24.308410 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-d64b743e-7455-4738-a7ea-04801af8b585 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:24.309465 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-d64b743e-7455-4738-a7ea-04801af8b585 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:24.315910 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d64b743e-7455-4738-a7ea-04801af8b585 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:24.316676 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d64b743e-7455-4738-a7ea-04801af8b585 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:24.317494 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d64b743e-7455-4738-a7ea-04801af8b585 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:24.317983 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-d64b743e-7455-4738-a7ea-04801af8b585 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:24.453677 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-d64b743e-7455-4738-a7ea-04801af8b585 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:24.461081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-d64b743e-7455-4738-a7ea-04801af8b585 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.156411 May 17 18:24:24.461656 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 552/1121] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:24 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:25.479669 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e5770172-a99f-411b-9fe9-f2ac64896737 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:25.480279 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e5770172-a99f-411b-9fe9-f2ac64896737 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:25.486264 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5770172-a99f-411b-9fe9-f2ac64896737 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:25.486757 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5770172-a99f-411b-9fe9-f2ac64896737 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:25.487527 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5770172-a99f-411b-9fe9-f2ac64896737 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:25.487965 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5770172-a99f-411b-9fe9-f2ac64896737 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:25.618958 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e5770172-a99f-411b-9fe9-f2ac64896737 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:25.626133 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e5770172-a99f-411b-9fe9-f2ac64896737 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1508 microversion: 2.1 time: 0.151172 May 17 18:24:25.626722 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 570/1122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:25 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:25.642178 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fc742b94-8c2a-45df-9649-173b92c4d382 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:25.642792 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fc742b94-8c2a-45df-9649-173b92c4d382 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:25.649577 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc742b94-8c2a-45df-9649-173b92c4d382 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:25.650025 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc742b94-8c2a-45df-9649-173b92c4d382 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:25.650880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc742b94-8c2a-45df-9649-173b92c4d382 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:25.651316 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc742b94-8c2a-45df-9649-173b92c4d382 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:25.722661 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc742b94-8c2a-45df-9649-173b92c4d382 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [4e765315-a4f9-4a1c-b4c8-2eda32b7415b] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 18:24:26.731112 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc742b94-8c2a-45df-9649-173b92c4d382 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [4e765315-a4f9-4a1c-b4c8-2eda32b7415b] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59132. May 17 18:24:26.734894 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fc742b94-8c2a-45df-9649-173b92c4d382 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "POST /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d/action" status: 202 len: 0 microversion: 2.1 time: 1.096625 May 17 18:24:26.735513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 553/1123] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 17 18:24:25 2022] POST /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d/action => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:24:26.743844 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-34e5c04b-217c-4eea-a8bc-c8a6683bbfe1 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:26.744461 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-34e5c04b-217c-4eea-a8bc-c8a6683bbfe1 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:26.750818 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-34e5c04b-217c-4eea-a8bc-c8a6683bbfe1 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:26.751273 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-34e5c04b-217c-4eea-a8bc-c8a6683bbfe1 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:26.752043 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-34e5c04b-217c-4eea-a8bc-c8a6683bbfe1 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:26.752481 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-34e5c04b-217c-4eea-a8bc-c8a6683bbfe1 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:26.891007 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-34e5c04b-217c-4eea-a8bc-c8a6683bbfe1 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:26.899372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-34e5c04b-217c-4eea-a8bc-c8a6683bbfe1 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1516 microversion: 2.1 time: 0.159721 May 17 18:24:26.899932 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 571/1124] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:26 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:27.379028 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-edf479bd-3d28-455a-8e0f-f4cca319b9ca req-fac8889b-8574-4136-b0f7-139ecfd3dc9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d", "name": "network-vif-unplugged", "status": "completed", "tag": "8cd46e6c-881d-4940-bcd6-fc6a73179551"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:27.392061 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-edf479bd-3d28-455a-8e0f-f4cca319b9ca req-fac8889b-8574-4136-b0f7-139ecfd3dc9a service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:27.392693 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-edf479bd-3d28-455a-8e0f-f4cca319b9ca req-fac8889b-8574-4136-b0f7-139ecfd3dc9a service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:27.406015 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.compute.server_external_events [req-edf479bd-3d28-455a-8e0f-f4cca319b9ca req-fac8889b-8574-4136-b0f7-139ecfd3dc9a service nova] Unable to find a host for instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d. Dropping event network-vif-unplugged {{(pid=117020) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 18:24:27.406999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-edf479bd-3d28-455a-8e0f-f4cca319b9ca req-fac8889b-8574-4136-b0f7-139ecfd3dc9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.091789 May 17 18:24:27.409138 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 554/1125] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 17 18:24:27.915724 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-8f7d2d90-439d-4617-8f34-ba9fa7953f47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:27.916344 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-8f7d2d90-439d-4617-8f34-ba9fa7953f47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:27.922799 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f7d2d90-439d-4617-8f34-ba9fa7953f47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:27.923259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f7d2d90-439d-4617-8f34-ba9fa7953f47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:27.924065 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f7d2d90-439d-4617-8f34-ba9fa7953f47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:27.925017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-8f7d2d90-439d-4617-8f34-ba9fa7953f47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:28.067085 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-8f7d2d90-439d-4617-8f34-ba9fa7953f47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:28.075542 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-8f7d2d90-439d-4617-8f34-ba9fa7953f47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1518 microversion: 2.1 time: 0.163746 May 17 18:24:28.076021 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 572/1126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:27 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:29.093034 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3dd72fe5-584f-4821-9b7c-7a3259467588 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:29.093592 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3dd72fe5-584f-4821-9b7c-7a3259467588 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:29.100083 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3dd72fe5-584f-4821-9b7c-7a3259467588 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:29.100538 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3dd72fe5-584f-4821-9b7c-7a3259467588 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:29.101305 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3dd72fe5-584f-4821-9b7c-7a3259467588 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:29.101750 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3dd72fe5-584f-4821-9b7c-7a3259467588 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:29.232854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-3dd72fe5-584f-4821-9b7c-7a3259467588 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:29.240920 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3dd72fe5-584f-4821-9b7c-7a3259467588 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.151256 May 17 18:24:29.241489 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 555/1127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:29 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:30.258637 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-686ef161-ffd3-4b5f-b673-ab853aa26af7 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:30.259247 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-686ef161-ffd3-4b5f-b673-ab853aa26af7 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:30.265592 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-686ef161-ffd3-4b5f-b673-ab853aa26af7 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:30.266039 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-686ef161-ffd3-4b5f-b673-ab853aa26af7 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:30.266833 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-686ef161-ffd3-4b5f-b673-ab853aa26af7 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:30.267264 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-686ef161-ffd3-4b5f-b673-ab853aa26af7 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:30.397819 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-686ef161-ffd3-4b5f-b673-ab853aa26af7 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:30.405070 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-686ef161-ffd3-4b5f-b673-ab853aa26af7 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.151122 May 17 18:24:30.405629 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 573/1128] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:30 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:31.422667 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-9d4fda49-84b2-47a4-a8cf-be431d5ca67b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:31.423262 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-9d4fda49-84b2-47a4-a8cf-be431d5ca67b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:31.430092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9d4fda49-84b2-47a4-a8cf-be431d5ca67b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:31.430546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9d4fda49-84b2-47a4-a8cf-be431d5ca67b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:31.431340 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9d4fda49-84b2-47a4-a8cf-be431d5ca67b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:31.431779 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-9d4fda49-84b2-47a4-a8cf-be431d5ca67b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:31.558909 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-9d4fda49-84b2-47a4-a8cf-be431d5ca67b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:31.566183 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-9d4fda49-84b2-47a4-a8cf-be431d5ca67b tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.147451 May 17 18:24:31.566779 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 556/1129] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:31 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:32.129398 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:24:32.129950 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Tue May 17 18:24:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:24:32.585177 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-d2c6cb02-ed07-41c9-820f-92e8c8e5d80d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:32.585784 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-d2c6cb02-ed07-41c9-820f-92e8c8e5d80d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:32.592591 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2c6cb02-ed07-41c9-820f-92e8c8e5d80d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:32.593036 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2c6cb02-ed07-41c9-820f-92e8c8e5d80d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:32.593823 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2c6cb02-ed07-41c9-820f-92e8c8e5d80d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:32.594256 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-d2c6cb02-ed07-41c9-820f-92e8c8e5d80d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:32.720579 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-d2c6cb02-ed07-41c9-820f-92e8c8e5d80d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:32.727999 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-d2c6cb02-ed07-41c9-820f-92e8c8e5d80d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.147433 May 17 18:24:32.728549 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 574/1130] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:32 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:33.745342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f03bbdc1-2721-4b38-95ae-79cb69a60a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:33.746033 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f03bbdc1-2721-4b38-95ae-79cb69a60a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:33.752345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f03bbdc1-2721-4b38-95ae-79cb69a60a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:33.752797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f03bbdc1-2721-4b38-95ae-79cb69a60a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:33.753563 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f03bbdc1-2721-4b38-95ae-79cb69a60a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:33.754002 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f03bbdc1-2721-4b38-95ae-79cb69a60a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:33.887708 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f03bbdc1-2721-4b38-95ae-79cb69a60a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:33.895029 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f03bbdc1-2721-4b38-95ae-79cb69a60a54 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.153510 May 17 18:24:33.895589 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 557/1131] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:33 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:34.911979 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-b1451575-7715-4f7b-9524-d9cbbe878760 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:34.912760 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-b1451575-7715-4f7b-9524-d9cbbe878760 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:34.919347 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b1451575-7715-4f7b-9524-d9cbbe878760 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:34.919919 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b1451575-7715-4f7b-9524-d9cbbe878760 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:34.920711 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b1451575-7715-4f7b-9524-d9cbbe878760 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:34.921149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-b1451575-7715-4f7b-9524-d9cbbe878760 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:35.056967 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-b1451575-7715-4f7b-9524-d9cbbe878760 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:35.064201 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-b1451575-7715-4f7b-9524-d9cbbe878760 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.156260 May 17 18:24:35.064759 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 575/1132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:34 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:36.081627 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f48cfb99-dd60-4609-bf95-c66faa3cef72 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:36.082282 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f48cfb99-dd60-4609-bf95-c66faa3cef72 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:36.088888 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f48cfb99-dd60-4609-bf95-c66faa3cef72 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:36.089349 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f48cfb99-dd60-4609-bf95-c66faa3cef72 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:36.090119 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f48cfb99-dd60-4609-bf95-c66faa3cef72 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:36.090563 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f48cfb99-dd60-4609-bf95-c66faa3cef72 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:36.223446 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f48cfb99-dd60-4609-bf95-c66faa3cef72 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:36.231854 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f48cfb99-dd60-4609-bf95-c66faa3cef72 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.154072 May 17 18:24:36.232424 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 558/1133] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:36 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:37.249162 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-be72851f-b999-4484-bf72-68336f2fe410 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:37.249772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-be72851f-b999-4484-bf72-68336f2fe410 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:37.256962 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-be72851f-b999-4484-bf72-68336f2fe410 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:37.257407 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-be72851f-b999-4484-bf72-68336f2fe410 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:37.258174 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-be72851f-b999-4484-bf72-68336f2fe410 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:37.258634 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-be72851f-b999-4484-bf72-68336f2fe410 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:37.388852 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-be72851f-b999-4484-bf72-68336f2fe410 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:37.396299 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-be72851f-b999-4484-bf72-68336f2fe410 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.150977 May 17 18:24:37.396896 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 576/1134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:37 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:38.413699 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-42cf6511-d20a-44f3-bae4-683665a53414 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:38.414314 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-42cf6511-d20a-44f3-bae4-683665a53414 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:38.420619 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-42cf6511-d20a-44f3-bae4-683665a53414 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:38.421077 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-42cf6511-d20a-44f3-bae4-683665a53414 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:38.421846 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-42cf6511-d20a-44f3-bae4-683665a53414 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:38.422287 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-42cf6511-d20a-44f3-bae4-683665a53414 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:38.553410 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-42cf6511-d20a-44f3-bae4-683665a53414 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:38.560693 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-42cf6511-d20a-44f3-bae4-683665a53414 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.151528 May 17 18:24:38.561255 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 559/1135] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:38 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:39.379554 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-39701584-f06f-4de7-a956-c79cb5a2eb2e req-844f77f3-398e-4aeb-82e9-2293ca4bf468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d", "name": "network-vif-plugged", "status": "completed", "tag": "8cd46e6c-881d-4940-bcd6-fc6a73179551"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:39.388030 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-39701584-f06f-4de7-a956-c79cb5a2eb2e req-844f77f3-398e-4aeb-82e9-2293ca4bf468 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:39.388460 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-39701584-f06f-4de7-a956-c79cb5a2eb2e req-844f77f3-398e-4aeb-82e9-2293ca4bf468 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:39.401664 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-39701584-f06f-4de7-a956-c79cb5a2eb2e req-844f77f3-398e-4aeb-82e9-2293ca4bf468 service nova] Creating event network-vif-plugged:8cd46e6c-881d-4940-bcd6-fc6a73179551 for instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d on hv-cinder-84130 May 17 18:24:39.406636 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-39701584-f06f-4de7-a956-c79cb5a2eb2e req-844f77f3-398e-4aeb-82e9-2293ca4bf468 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030774 May 17 18:24:39.407238 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 577/1136] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:24:39.577892 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-5775f9f1-48fb-4f22-978f-00bbbc48ad47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:39.578425 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-5775f9f1-48fb-4f22-978f-00bbbc48ad47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:39.585042 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5775f9f1-48fb-4f22-978f-00bbbc48ad47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:39.585491 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5775f9f1-48fb-4f22-978f-00bbbc48ad47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:39.586266 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5775f9f1-48fb-4f22-978f-00bbbc48ad47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:39.586745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-5775f9f1-48fb-4f22-978f-00bbbc48ad47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:39.720192 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-5775f9f1-48fb-4f22-978f-00bbbc48ad47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:39.728377 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-5775f9f1-48fb-4f22-978f-00bbbc48ad47 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.154440 May 17 18:24:39.728938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 560/1137] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:39 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:40.745943 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-46337289-5cf5-4a2e-aeb0-66aeb37dec2d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:40.746676 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-46337289-5cf5-4a2e-aeb0-66aeb37dec2d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:40.752856 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46337289-5cf5-4a2e-aeb0-66aeb37dec2d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:40.753308 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46337289-5cf5-4a2e-aeb0-66aeb37dec2d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:40.754071 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46337289-5cf5-4a2e-aeb0-66aeb37dec2d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:40.754506 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46337289-5cf5-4a2e-aeb0-66aeb37dec2d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:40.883421 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-46337289-5cf5-4a2e-aeb0-66aeb37dec2d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:40.890828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-46337289-5cf5-4a2e-aeb0-66aeb37dec2d tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1574 microversion: 2.1 time: 0.150238 May 17 18:24:40.891395 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 578/1138] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:40 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:41.907874 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-fc774de9-cd9d-434b-8143-64dd9168381f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:41.908479 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-fc774de9-cd9d-434b-8143-64dd9168381f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:41.915847 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc774de9-cd9d-434b-8143-64dd9168381f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:41.916307 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc774de9-cd9d-434b-8143-64dd9168381f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:41.917080 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc774de9-cd9d-434b-8143-64dd9168381f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:41.917521 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-fc774de9-cd9d-434b-8143-64dd9168381f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:42.049867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-fc774de9-cd9d-434b-8143-64dd9168381f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:42.057837 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-fc774de9-cd9d-434b-8143-64dd9168381f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1561 microversion: 2.1 time: 0.153848 May 17 18:24:42.058392 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 561/1139] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:24:41 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:05.532406 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-cbc1c295-a220-4cdb-ae28-fdb37e64ac7e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:05.533019 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-cbc1c295-a220-4cdb-ae28-fdb37e64ac7e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:05.538904 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cbc1c295-a220-4cdb-ae28-fdb37e64ac7e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.539532 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cbc1c295-a220-4cdb-ae28-fdb37e64ac7e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.540303 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cbc1c295-a220-4cdb-ae28-fdb37e64ac7e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.540737 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-cbc1c295-a220-4cdb-ae28-fdb37e64ac7e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.564545 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-cbc1c295-a220-4cdb-ae28-fdb37e64ac7e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:25:05.637150 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-cbc1c295-a220-4cdb-ae28-fdb37e64ac7e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 204 len: 0 microversion: 2.1 time: 0.108450 May 17 18:25:05.637708 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 579/1140] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:25:05 2022] DELETE /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:25:05.646125 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-57a17530-3151-470a-ad2a-232473a07782 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:05.646766 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-57a17530-3151-470a-ad2a-232473a07782 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:05.653607 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57a17530-3151-470a-ad2a-232473a07782 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.654058 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57a17530-3151-470a-ad2a-232473a07782 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.654850 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57a17530-3151-470a-ad2a-232473a07782 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.655287 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-57a17530-3151-470a-ad2a-232473a07782 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.782291 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-57a17530-3151-470a-ad2a-232473a07782 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:05.789716 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-57a17530-3151-470a-ad2a-232473a07782 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1575 microversion: 2.1 time: 0.147532 May 17 18:25:05.790219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 562/1141] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:05 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:06.808199 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-9b937893-70ae-4698-ba9c-330d05dac99a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:06.808902 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-9b937893-70ae-4698-ba9c-330d05dac99a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:06.815190 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9b937893-70ae-4698-ba9c-330d05dac99a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:06.815651 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9b937893-70ae-4698-ba9c-330d05dac99a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:06.816424 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9b937893-70ae-4698-ba9c-330d05dac99a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:06.816894 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-9b937893-70ae-4698-ba9c-330d05dac99a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:06.955116 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-9b937893-70ae-4698-ba9c-330d05dac99a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:06.963361 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-9b937893-70ae-4698-ba9c-330d05dac99a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1575 microversion: 2.1 time: 0.160352 May 17 18:25:06.963940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 580/1142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:06 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:07.980745 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-6444b1c3-7282-4c57-9605-5496a05a3cee tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:07.981546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-6444b1c3-7282-4c57-9605-5496a05a3cee tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:07.988124 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6444b1c3-7282-4c57-9605-5496a05a3cee tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:07.988570 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6444b1c3-7282-4c57-9605-5496a05a3cee tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:07.989342 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6444b1c3-7282-4c57-9605-5496a05a3cee tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:07.989949 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-6444b1c3-7282-4c57-9605-5496a05a3cee tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.124337 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-6444b1c3-7282-4c57-9605-5496a05a3cee tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:08.135191 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-6444b1c3-7282-4c57-9605-5496a05a3cee tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 200 len: 1575 microversion: 2.1 time: 0.158757 May 17 18:25:08.135774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 563/1143] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:07 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:08.547231 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-d894a537-abe3-4494-a334-40310d02dadf req-749d8c92-c41e-44bc-9cc4-93f009ec40fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81a563a-5441-4226-b0af-8e83d90e64ac", "name": "network-vif-deleted", "tag": "cc2e0d37-6a6e-407e-9504-4e11aee8a14e"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:08.555928 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-d894a537-abe3-4494-a334-40310d02dadf req-749d8c92-c41e-44bc-9cc4-93f009ec40fc service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:08.556376 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-d894a537-abe3-4494-a334-40310d02dadf req-749d8c92-c41e-44bc-9cc4-93f009ec40fc service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.568637 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-d894a537-abe3-4494-a334-40310d02dadf req-749d8c92-c41e-44bc-9cc4-93f009ec40fc service nova] Creating event network-vif-deleted:cc2e0d37-6a6e-407e-9504-4e11aee8a14e for instance d81a563a-5441-4226-b0af-8e83d90e64ac on hv-cinder-84130 May 17 18:25:08.574612 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-d894a537-abe3-4494-a334-40310d02dadf req-749d8c92-c41e-44bc-9cc4-93f009ec40fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150468 May 17 18:25:08.578613 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 581/1144] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:09.154506 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-13605ef3-24ff-4b68-8222-920dbc098402 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:09.155150 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-13605ef3-24ff-4b68-8222-920dbc098402 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:09.161091 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-13605ef3-24ff-4b68-8222-920dbc098402 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:09.161543 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-13605ef3-24ff-4b68-8222-920dbc098402 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:09.162314 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-13605ef3-24ff-4b68-8222-920dbc098402 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:09.162783 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-13605ef3-24ff-4b68-8222-920dbc098402 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:09.177415 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-13605ef3-24ff-4b68-8222-920dbc098402 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] HTTP exception thrown: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-13605ef3-24ff-4b68-8222-920dbc098402 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Request method failure captured: May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac HTTP/1.1 May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-fljdy9APNz-tl1IHZXlUwd7-hd4CP6c-W6nLH1xaibi3NmU2RTsAmzeK8z_WMyqVKqEKwicu7FH2LGJpxEkIbCrjTOhS6DryC0628jsKBGRwqU4KqlMUySuaRWb57qdlD6sEd_MGs9l0AjIbpsiVoKpt5PdaXqEV0IvxlZFC64eYw May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: af75981c6f0c44168aa9123430944fd2 May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-TestVolumeBootPattern-519166492 May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:25:09.179092 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af75981c6f0c44168aa9123430944fd2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-TestVolumeBootPattern-519166492 May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: af75981c6f0c44168aa9123430944fd2 May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-TestVolumeBootPattern-519166492 May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-TestVolumeBootPattern-519166492-project May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 91d999e39c144d04ac8c6ca5a4660d24 May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-TestVolumeBootPattern-519166492-project May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:25:09.181317 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': 'd81a563a-5441-4226-b0af-8e83d90e64ac'} May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:25:09.182205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:25:09.184797 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:25:09.187439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-13605ef3-24ff-4b68-8222-920dbc098402 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Returning 404 to user: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:25:09.188302 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-13605ef3-24ff-4b68-8222-920dbc098402 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 404 len: 111 microversion: 2.1 time: 0.040469 May 17 18:25:09.188866 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 564/1145] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:09 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:25:09.239432 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-4916292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-718503433", "security_groups": [{"name": "tempest-secgroup-smoke-1753324118"}], "block_device_mapping_v2": [{"uuid": "74efecfb-f1ac-411f-b64d-83a73a228761", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd052ceb-f845-4dfa-9472-80cdd5ad993a"}]}} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:09.353713 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.network.neutron [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] validate_networks() for [('fd052ceb-f845-4dfa-9472-80cdd5ad993a', None, None, None, None, None)] {{(pid=117021) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:25:09.801784 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Flavor limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:25:09.802378 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Image limits 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:25:09.802730 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Flavor pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:25:09.803140 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Image pref 0:0:0 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:25:09.803549 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.virt.hardware [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:25:09.812855 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:09.813302 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:09.814101 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:09.814558 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:09.831078 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Getting quotas for project af75981c6f0c44168aa9123430944fd2. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:25:09.834950 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.quota [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Getting quotas for user 91d999e39c144d04ac8c6ca5a4660d24 and project af75981c6f0c44168aa9123430944fd2. Resources: {'ram', 'cores', 'instances'} {{(pid=117021) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:25:09.890788 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Going to run 1 instances... {{(pid=117021) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:25:09.892981 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74efecfb-f1ac-411f-b64d-83a73a228761',volume_size=None,volume_type=None)] {{(pid=117021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:25:10.025261 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-43a8702b-1b69-4745-8d09-a2202519a759 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789938 May 17 18:25:10.025930 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 582/1146] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:25:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:25:10.035825 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bf265040-fec7-417c-b0ec-5f80f8414491 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:10.036439 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-bf265040-fec7-417c-b0ec-5f80f8414491 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:10.088705 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-bf265040-fec7-417c-b0ec-5f80f8414491 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:10.095364 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-bf265040-fec7-417c-b0ec-5f80f8414491 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1091 microversion: 2.1 time: 0.063413 May 17 18:25:10.096013 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 565/1147] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:10 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1091 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:11.112223 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-46211c97-ae98-4950-b042-be32d1e01a40 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:11.112951 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-46211c97-ae98-4950-b042-be32d1e01a40 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:11.121689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46211c97-ae98-4950-b042-be32d1e01a40 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.122364 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46211c97-ae98-4950-b042-be32d1e01a40 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.123219 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46211c97-ae98-4950-b042-be32d1e01a40 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.123694 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-46211c97-ae98-4950-b042-be32d1e01a40 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.196870 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-46211c97-ae98-4950-b042-be32d1e01a40 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:11.204893 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-46211c97-ae98-4950-b042-be32d1e01a40 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1207 microversion: 2.1 time: 0.096665 May 17 18:25:11.205466 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 583/1148] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:11 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1207 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:12.222852 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-65c42596-cb72-409a-8c15-b6d5e28ee850 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:12.223504 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-65c42596-cb72-409a-8c15-b6d5e28ee850 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:12.232495 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-65c42596-cb72-409a-8c15-b6d5e28ee850 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:12.232955 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-65c42596-cb72-409a-8c15-b6d5e28ee850 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:12.233841 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-65c42596-cb72-409a-8c15-b6d5e28ee850 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:12.234461 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-65c42596-cb72-409a-8c15-b6d5e28ee850 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:12.303681 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-e28cebb6-f294-48ef-8514-19927debb507 req-533c0f28-0c41-44cd-84f7-070bad4bdf85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0265396a-e033-4631-b339-ec6ccf7b7fe2", "tag": "21635e39-b9c3-4c64-becd-0e1f113b368c"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:12.316227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-e28cebb6-f294-48ef-8514-19927debb507 req-533c0f28-0c41-44cd-84f7-070bad4bdf85 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:12.316983 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-e28cebb6-f294-48ef-8514-19927debb507 req-533c0f28-0c41-44cd-84f7-070bad4bdf85 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:12.332477 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-e28cebb6-f294-48ef-8514-19927debb507 req-533c0f28-0c41-44cd-84f7-070bad4bdf85 service nova] Creating event network-changed:21635e39-b9c3-4c64-becd-0e1f113b368c for instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 on hv-cinder-84130 May 17 18:25:12.346135 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-e28cebb6-f294-48ef-8514-19927debb507 req-533c0f28-0c41-44cd-84f7-070bad4bdf85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047601 May 17 18:25:12.347286 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 584/1149] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:12.403357 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-65c42596-cb72-409a-8c15-b6d5e28ee850 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:12.411679 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-65c42596-cb72-409a-8c15-b6d5e28ee850 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.192624 May 17 18:25:12.412266 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 566/1150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:12 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:13.431135 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-93fe237b-5bff-4967-a91a-77bd854b0c82 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:13.431851 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-93fe237b-5bff-4967-a91a-77bd854b0c82 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:13.437829 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93fe237b-5bff-4967-a91a-77bd854b0c82 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:13.438276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93fe237b-5bff-4967-a91a-77bd854b0c82 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:13.439080 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93fe237b-5bff-4967-a91a-77bd854b0c82 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:13.439519 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-93fe237b-5bff-4967-a91a-77bd854b0c82 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:13.570691 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-93fe237b-5bff-4967-a91a-77bd854b0c82 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:13.577909 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-93fe237b-5bff-4967-a91a-77bd854b0c82 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.152181 May 17 18:25:13.578414 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 585/1151] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:13 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:14.595021 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f434b981-97f4-4633-9f52-2ff3369a4f76 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:14.595642 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f434b981-97f4-4633-9f52-2ff3369a4f76 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:14.602617 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f434b981-97f4-4633-9f52-2ff3369a4f76 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.603058 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f434b981-97f4-4633-9f52-2ff3369a4f76 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.603820 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f434b981-97f4-4633-9f52-2ff3369a4f76 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.604265 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f434b981-97f4-4633-9f52-2ff3369a4f76 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.731709 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f434b981-97f4-4633-9f52-2ff3369a4f76 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:14.739517 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f434b981-97f4-4633-9f52-2ff3369a4f76 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.148277 May 17 18:25:14.740088 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 567/1152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:14 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:15.756570 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-286cbc3b-dfa0-43e4-8111-6c54ae63c899 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:15.757187 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-286cbc3b-dfa0-43e4-8111-6c54ae63c899 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:15.763611 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-286cbc3b-dfa0-43e4-8111-6c54ae63c899 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:15.764064 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-286cbc3b-dfa0-43e4-8111-6c54ae63c899 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:15.764837 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-286cbc3b-dfa0-43e4-8111-6c54ae63c899 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:15.765276 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-286cbc3b-dfa0-43e4-8111-6c54ae63c899 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:15.890456 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-286cbc3b-dfa0-43e4-8111-6c54ae63c899 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:15.897710 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-286cbc3b-dfa0-43e4-8111-6c54ae63c899 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.145026 May 17 18:25:15.898808 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 586/1153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:15 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:16.915313 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ac288bc9-0dd8-4179-af6a-061aa5c818c6 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:16.916303 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ac288bc9-0dd8-4179-af6a-061aa5c818c6 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:16.923219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ac288bc9-0dd8-4179-af6a-061aa5c818c6 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:16.923673 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ac288bc9-0dd8-4179-af6a-061aa5c818c6 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:16.924452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ac288bc9-0dd8-4179-af6a-061aa5c818c6 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:16.925082 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ac288bc9-0dd8-4179-af6a-061aa5c818c6 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:17.056943 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-ac288bc9-0dd8-4179-af6a-061aa5c818c6 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:17.064149 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ac288bc9-0dd8-4179-af6a-061aa5c818c6 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.153275 May 17 18:25:17.064706 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 568/1154] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:16 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:18.081128 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5a68b7f3-dfa8-4e21-8e1a-69b3ac9725e7 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:18.081744 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5a68b7f3-dfa8-4e21-8e1a-69b3ac9725e7 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:18.088754 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5a68b7f3-dfa8-4e21-8e1a-69b3ac9725e7 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:18.089209 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5a68b7f3-dfa8-4e21-8e1a-69b3ac9725e7 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:18.089986 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5a68b7f3-dfa8-4e21-8e1a-69b3ac9725e7 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:18.090425 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5a68b7f3-dfa8-4e21-8e1a-69b3ac9725e7 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:18.220712 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-5a68b7f3-dfa8-4e21-8e1a-69b3ac9725e7 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:18.228194 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5a68b7f3-dfa8-4e21-8e1a-69b3ac9725e7 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.150980 May 17 18:25:18.228756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 587/1155] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:18 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:19.244966 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-7e670a43-a791-44c1-8294-98c2c0301b1f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:19.245573 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-7e670a43-a791-44c1-8294-98c2c0301b1f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:19.251938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7e670a43-a791-44c1-8294-98c2c0301b1f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.252390 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7e670a43-a791-44c1-8294-98c2c0301b1f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.253155 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7e670a43-a791-44c1-8294-98c2c0301b1f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.253625 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-7e670a43-a791-44c1-8294-98c2c0301b1f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.382246 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-7e670a43-a791-44c1-8294-98c2c0301b1f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:19.390061 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-7e670a43-a791-44c1-8294-98c2c0301b1f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.149086 May 17 18:25:19.390642 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 569/1156] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:19 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:20.405829 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-36d9ed2b-b866-44f3-a5b3-36f382330661 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:20.406442 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-36d9ed2b-b866-44f3-a5b3-36f382330661 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:20.412895 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-36d9ed2b-b866-44f3-a5b3-36f382330661 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:20.413353 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-36d9ed2b-b866-44f3-a5b3-36f382330661 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.414641 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-36d9ed2b-b866-44f3-a5b3-36f382330661 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:20.415081 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-36d9ed2b-b866-44f3-a5b3-36f382330661 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.540807 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-36d9ed2b-b866-44f3-a5b3-36f382330661 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:20.548015 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-36d9ed2b-b866-44f3-a5b3-36f382330661 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.146059 May 17 18:25:20.548579 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 588/1157] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:20 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:21.565117 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4690c386-6d58-4a03-ae31-69278b4eafcf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:21.565727 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4690c386-6d58-4a03-ae31-69278b4eafcf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:21.573167 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4690c386-6d58-4a03-ae31-69278b4eafcf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:21.573617 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4690c386-6d58-4a03-ae31-69278b4eafcf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:21.574384 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4690c386-6d58-4a03-ae31-69278b4eafcf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:21.574849 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4690c386-6d58-4a03-ae31-69278b4eafcf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:21.704212 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4690c386-6d58-4a03-ae31-69278b4eafcf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:21.712414 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4690c386-6d58-4a03-ae31-69278b4eafcf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.151125 May 17 18:25:21.712993 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 570/1158] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:21 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:22.729369 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-22a6dd18-c2e8-4a65-95cd-e0f0de818032 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:22.730047 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-22a6dd18-c2e8-4a65-95cd-e0f0de818032 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:22.736378 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-22a6dd18-c2e8-4a65-95cd-e0f0de818032 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:22.736832 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-22a6dd18-c2e8-4a65-95cd-e0f0de818032 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:22.737598 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-22a6dd18-c2e8-4a65-95cd-e0f0de818032 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:22.738040 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-22a6dd18-c2e8-4a65-95cd-e0f0de818032 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:22.868243 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-22a6dd18-c2e8-4a65-95cd-e0f0de818032 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:22.875564 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-22a6dd18-c2e8-4a65-95cd-e0f0de818032 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.150281 May 17 18:25:22.876133 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 589/1159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:22 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:23.662815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-f8bbf4e3-1bdd-4aa5-878e-816e815bac9b req-9f961784-3e62-4c84-87f0-93b8431aec03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0265396a-e033-4631-b339-ec6ccf7b7fe2", "name": "network-vif-plugged", "status": "completed", "tag": "21635e39-b9c3-4c64-becd-0e1f113b368c"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:23.671581 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-f8bbf4e3-1bdd-4aa5-878e-816e815bac9b req-9f961784-3e62-4c84-87f0-93b8431aec03 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:23.672037 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-f8bbf4e3-1bdd-4aa5-878e-816e815bac9b req-9f961784-3e62-4c84-87f0-93b8431aec03 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:23.683325 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-f8bbf4e3-1bdd-4aa5-878e-816e815bac9b req-9f961784-3e62-4c84-87f0-93b8431aec03 service nova] Creating event network-vif-plugged:21635e39-b9c3-4c64-becd-0e1f113b368c for instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 on hv-cinder-84130 May 17 18:25:23.688285 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-f8bbf4e3-1bdd-4aa5-878e-816e815bac9b req-9f961784-3e62-4c84-87f0-93b8431aec03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029539 May 17 18:25:23.688880 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 571/1160] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:23.893225 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0a5ac9ed-187d-490f-97e4-3751bd674496 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:23.893822 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0a5ac9ed-187d-490f-97e4-3751bd674496 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:23.900311 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0a5ac9ed-187d-490f-97e4-3751bd674496 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:23.900770 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0a5ac9ed-187d-490f-97e4-3751bd674496 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:23.901553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0a5ac9ed-187d-490f-97e4-3751bd674496 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:23.901995 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0a5ac9ed-187d-490f-97e4-3751bd674496 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:24.032246 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0a5ac9ed-187d-490f-97e4-3751bd674496 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:24.039610 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0a5ac9ed-187d-490f-97e4-3751bd674496 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1263 microversion: 2.1 time: 0.150476 May 17 18:25:24.040137 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 590/1161] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:23 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:25.058156 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-310b8cf3-ca02-4a82-bfe6-001f9e1db48e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:25.058894 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-310b8cf3-ca02-4a82-bfe6-001f9e1db48e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:25.064963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-310b8cf3-ca02-4a82-bfe6-001f9e1db48e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:25.065440 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-310b8cf3-ca02-4a82-bfe6-001f9e1db48e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:25.066200 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-310b8cf3-ca02-4a82-bfe6-001f9e1db48e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:25.066662 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-310b8cf3-ca02-4a82-bfe6-001f9e1db48e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:25.201011 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-310b8cf3-ca02-4a82-bfe6-001f9e1db48e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:25.208310 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-310b8cf3-ca02-4a82-bfe6-001f9e1db48e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1449 microversion: 2.1 time: 0.155820 May 17 18:25:25.208876 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 572/1162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:25 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:25.224739 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-0ed4739f-a2de-418e-baba-ef1fdbc6f81b tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:25.225350 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-0ed4739f-a2de-418e-baba-ef1fdbc6f81b tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:25.231887 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0ed4739f-a2de-418e-baba-ef1fdbc6f81b tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:25.232331 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0ed4739f-a2de-418e-baba-ef1fdbc6f81b tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:25.233095 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0ed4739f-a2de-418e-baba-ef1fdbc6f81b tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:25.233528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-0ed4739f-a2de-418e-baba-ef1fdbc6f81b tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:25.360495 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-0ed4739f-a2de-418e-baba-ef1fdbc6f81b tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:25.367886 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-0ed4739f-a2de-418e-baba-ef1fdbc6f81b tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1449 microversion: 2.1 time: 0.146979 May 17 18:25:25.368449 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 591/1163] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:25 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:27.245525 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-c6677311-8046-4af4-a24f-83fb2e01deb6 req-54266466-f178-41a2-93d8-0a12c053cc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0265396a-e033-4631-b339-ec6ccf7b7fe2", "tag": "21635e39-b9c3-4c64-becd-0e1f113b368c"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:27.253509 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-c6677311-8046-4af4-a24f-83fb2e01deb6 req-54266466-f178-41a2-93d8-0a12c053cc26 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:27.253963 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-c6677311-8046-4af4-a24f-83fb2e01deb6 req-54266466-f178-41a2-93d8-0a12c053cc26 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:27.267688 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-c6677311-8046-4af4-a24f-83fb2e01deb6 req-54266466-f178-41a2-93d8-0a12c053cc26 service nova] Creating event network-changed:21635e39-b9c3-4c64-becd-0e1f113b368c for instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 on hv-cinder-84130 May 17 18:25:27.272618 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-c6677311-8046-4af4-a24f-83fb2e01deb6 req-54266466-f178-41a2-93d8-0a12c053cc26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093989 May 17 18:25:27.273877 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 573/1164] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:58.524490 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f14ff7d8-0372-4adb-9257-04f728f0fa2a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:58.525017 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f14ff7d8-0372-4adb-9257-04f728f0fa2a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:58.531213 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f14ff7d8-0372-4adb-9257-04f728f0fa2a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:58.531673 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f14ff7d8-0372-4adb-9257-04f728f0fa2a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:58.532083 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-eceeea6f-dd4b-4a43-9d90-4fae8e278c74 req-e85e1505-f944-4d71-856f-49e7987565b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d", "tag": "8cd46e6c-881d-4940-bcd6-fc6a73179551"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:58.532534 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f14ff7d8-0372-4adb-9257-04f728f0fa2a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:58.532872 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-f14ff7d8-0372-4adb-9257-04f728f0fa2a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:58.541142 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-eceeea6f-dd4b-4a43-9d90-4fae8e278c74 req-e85e1505-f944-4d71-856f-49e7987565b3 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:58.541915 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-eceeea6f-dd4b-4a43-9d90-4fae8e278c74 req-e85e1505-f944-4d71-856f-49e7987565b3 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:58.552690 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-eceeea6f-dd4b-4a43-9d90-4fae8e278c74 req-e85e1505-f944-4d71-856f-49e7987565b3 service nova] Creating event network-changed:8cd46e6c-881d-4940-bcd6-fc6a73179551 for instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d on hv-cinder-84130 May 17 18:25:58.558219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-eceeea6f-dd4b-4a43-9d90-4fae8e278c74 req-e85e1505-f944-4d71-856f-49e7987565b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030927 May 17 18:25:58.558417 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f14ff7d8-0372-4adb-9257-04f728f0fa2a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Going to try to terminate instance {{(pid=117021) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:25:58.559231 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 574/1165] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:58.649554 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f14ff7d8-0372-4adb-9257-04f728f0fa2a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 204 len: 0 microversion: 2.1 time: 0.129108 May 17 18:25:58.650355 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 592/1166] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:25:58 2022] DELETE /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:25:58.658958 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-bf7c926e-7b0a-4ad3-bf9f-5cf4272bf51f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:58.659676 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-bf7c926e-7b0a-4ad3-bf9f-5cf4272bf51f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:58.667116 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bf7c926e-7b0a-4ad3-bf9f-5cf4272bf51f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:58.667525 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bf7c926e-7b0a-4ad3-bf9f-5cf4272bf51f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:58.668309 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bf7c926e-7b0a-4ad3-bf9f-5cf4272bf51f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:58.668753 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-bf7c926e-7b0a-4ad3-bf9f-5cf4272bf51f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:58.804286 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-bf7c926e-7b0a-4ad3-bf9f-5cf4272bf51f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:58.812222 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-bf7c926e-7b0a-4ad3-bf9f-5cf4272bf51f tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.157447 May 17 18:25:58.813010 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 575/1167] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:58 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:59.830657 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-91e0217e-25b5-4584-a144-715fac628a61 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:59.832390 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-91e0217e-25b5-4584-a144-715fac628a61 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:59.839151 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-91e0217e-25b5-4584-a144-715fac628a61 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:59.839601 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-91e0217e-25b5-4584-a144-715fac628a61 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:59.841004 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-91e0217e-25b5-4584-a144-715fac628a61 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:59.841441 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-91e0217e-25b5-4584-a144-715fac628a61 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:59.978113 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-91e0217e-25b5-4584-a144-715fac628a61 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:59.985463 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-91e0217e-25b5-4584-a144-715fac628a61 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1567 microversion: 2.1 time: 0.159084 May 17 18:25:59.986027 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 593/1168] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:25:59 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:00.800647 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-9cce47ce-e936-421a-b815-053a14e3fa08 req-9d65d195-e0bf-4a4d-9012-cc14c865f5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d", "name": "network-vif-deleted", "tag": "8cd46e6c-881d-4940-bcd6-fc6a73179551"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:00.809991 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-9cce47ce-e936-421a-b815-053a14e3fa08 req-9d65d195-e0bf-4a4d-9012-cc14c865f5fd service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:00.810440 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-9cce47ce-e936-421a-b815-053a14e3fa08 req-9d65d195-e0bf-4a4d-9012-cc14c865f5fd service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:00.822834 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-9cce47ce-e936-421a-b815-053a14e3fa08 req-9d65d195-e0bf-4a4d-9012-cc14c865f5fd service nova] Creating event network-vif-deleted:8cd46e6c-881d-4940-bcd6-fc6a73179551 for instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d on hv-cinder-84130 May 17 18:26:00.828764 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-9cce47ce-e936-421a-b815-053a14e3fa08 req-9d65d195-e0bf-4a4d-9012-cc14c865f5fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031702 May 17 18:26:00.829366 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 576/1169] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:01.003013 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-a42ebb78-3839-46f4-bdf8-d483abadb355 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:01.003553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-a42ebb78-3839-46f4-bdf8-d483abadb355 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:01.010487 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a42ebb78-3839-46f4-bdf8-d483abadb355 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:01.010958 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a42ebb78-3839-46f4-bdf8-d483abadb355 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:01.011718 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a42ebb78-3839-46f4-bdf8-d483abadb355 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:01.012149 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-a42ebb78-3839-46f4-bdf8-d483abadb355 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:01.075830 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-a42ebb78-3839-46f4-bdf8-d483abadb355 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '240c3f3cc9e943a883e08e6c096edc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c948c388ed4ad7bd63255d5c643e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:01.085021 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-a42ebb78-3839-46f4-bdf8-d483abadb355 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 200 len: 1220 microversion: 2.1 time: 0.085875 May 17 18:26:01.086459 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 594/1170] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:26:00 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:02.104718 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3d7cdca4-d6ae-4666-b6ca-a0b065a0ec5a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:02.105332 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-3d7cdca4-d6ae-4666-b6ca-a0b065a0ec5a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] [instance: 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:02.111545 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3d7cdca4-d6ae-4666-b6ca-a0b065a0ec5a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:02.111994 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3d7cdca4-d6ae-4666-b6ca-a0b065a0ec5a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:02.112789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3d7cdca4-d6ae-4666-b6ca-a0b065a0ec5a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:02.113227 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-3d7cdca4-d6ae-4666-b6ca-a0b065a0ec5a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:02.126194 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-3d7cdca4-d6ae-4666-b6ca-a0b065a0ec5a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] HTTP exception thrown: Instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d could not be found. May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3d7cdca4-d6ae-4666-b6ca-a0b065a0ec5a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Request method failure captured: May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d HTTP/1.1 May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-en9f8640JAjyWS537ZxEz1oP-OJZAvMr477W8xG03DgWm552mdtptkibXcqqWrWcbBqbd84FRZDdu_y3-twlP3HMGih7eOYomShzAMczxAAr9aqolyFGG_uqrEzJaw3hRAr-WFm_ktaqswR4YT1v0kJ5AKq_zfM58hMJY5gi6Kso0 May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: 43c948c388ed4ad7bd63255d5c643e11 May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-TestShelveInstance-2000301466 May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:26:02.127828 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43c948c388ed4ad7bd63255d5c643e11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43c948c388ed4ad7bd63255d5c643e11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43c948c388ed4ad7bd63255d5c643e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43c948c388ed4ad7bd63255d5c643e11", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-TestShelveInstance-2000301466 May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: 43c948c388ed4ad7bd63255d5c643e11 May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-TestShelveInstance-2000301466 May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-TestShelveInstance-2000301466-project May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 240c3f3cc9e943a883e08e6c096edc51 May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-TestShelveInstance-2000301466-project May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d could not be found. May 17 18:26:02.129566 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': '1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d'} May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d could not be found. May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:26:02.130631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d could not be found. May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d could not be found. May 17 18:26:02.132345 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:26:02.133789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-3d7cdca4-d6ae-4666-b6ca-a0b065a0ec5a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Returning 404 to user: Instance 1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:26:02.133789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-3d7cdca4-d6ae-4666-b6ca-a0b065a0ec5a tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d" status: 404 len: 111 microversion: 2.1 time: 0.030076 May 17 18:26:02.133789 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 577/1171] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:26:02 2022] GET /compute/v2.1/servers/1df3f9ce-6cf5-4d53-98c0-ecfa480e6b3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:26:02.285259 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-6f6ddd27-c491-49ba-bfd8-48973d83e8e0 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] Calling method '.version_select at 0x7f74ab63a820>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:02.310471 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-6f6ddd27-c491-49ba-bfd8-48973d83e8e0 tempest-TestShelveInstance-2000301466 tempest-TestShelveInstance-2000301466-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1599786495" status: 202 len: 0 microversion: 2.1 time: 0.028756 May 17 18:26:02.311722 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 595/1172] 10.222.0.25 () {58 vars in 1253 bytes} [Tue May 17 18:26:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1599786495 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:27:02.180585 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1397106453", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-718503433", "security_groups": [{"name": "tempest-secgroup-smoke-1753324118"}], "block_device_mapping_v2": [{"uuid": "b2bad7cb-f00f-4e82-898e-0d5042213ace", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd052ceb-f845-4dfa-9472-80cdd5ad993a"}]}} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:02.292351 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.network.neutron [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] validate_networks() for [('fd052ceb-f845-4dfa-9472-80cdd5ad993a', None, None, None, None, None)] {{(pid=117020) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:27:02.753027 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Flavor limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:27:02.753449 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Image limits 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:27:02.753929 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Flavor pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:27:02.754334 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Image pref 0:0:0 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:27:02.754812 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.virt.hardware [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:27:02.766524 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:02.767159 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:02.768206 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:02.768799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:02.787332 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Getting quotas for project af75981c6f0c44168aa9123430944fd2. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:27:02.791750 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.quota [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Getting quotas for user 91d999e39c144d04ac8c6ca5a4660d24 and project af75981c6f0c44168aa9123430944fd2. Resources: {'ram', 'cores', 'instances'} {{(pid=117020) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:27:02.852546 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Going to run 1 instances... {{(pid=117020) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:27:02.854686 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2bad7cb-f00f-4e82-898e-0d5042213ace',volume_size=None,volume_type=None)] {{(pid=117020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:27:02.980513 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-08e721e0-972a-442a-abe9-995e79179828 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.804634 May 17 18:27:02.981872 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 578/1173] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 17 18:27:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:27:02.992994 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-f182be43-a37d-478b-8558-f812abaaae5a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:02.993604 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-f182be43-a37d-478b-8558-f812abaaae5a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:03.048558 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-f182be43-a37d-478b-8558-f812abaaae5a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:03.055056 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-f182be43-a37d-478b-8558-f812abaaae5a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1094 microversion: 2.1 time: 0.067155 May 17 18:27:03.055619 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 596/1174] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:02 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:04.073242 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-cf405e55-2906-4b8f-8613-5a59b5db1b77 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:04.073868 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-cf405e55-2906-4b8f-8613-5a59b5db1b77 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:04.081528 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cf405e55-2906-4b8f-8613-5a59b5db1b77 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:04.081993 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cf405e55-2906-4b8f-8613-5a59b5db1b77 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:04.082815 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cf405e55-2906-4b8f-8613-5a59b5db1b77 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:04.083262 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-cf405e55-2906-4b8f-8613-5a59b5db1b77 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:04.150374 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-cf405e55-2906-4b8f-8613-5a59b5db1b77 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:04.158309 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-cf405e55-2906-4b8f-8613-5a59b5db1b77 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1210 microversion: 2.1 time: 0.089882 May 17 18:27:04.158915 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 579/1175] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:04 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:05.178546 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-792d2cd6-7759-4980-aacf-ed80a10bf1c0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:05.179544 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-792d2cd6-7759-4980-aacf-ed80a10bf1c0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:05.187823 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-792d2cd6-7759-4980-aacf-ed80a10bf1c0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:05.188421 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-792d2cd6-7759-4980-aacf-ed80a10bf1c0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:05.189356 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-792d2cd6-7759-4980-aacf-ed80a10bf1c0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:05.189904 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-792d2cd6-7759-4980-aacf-ed80a10bf1c0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:05.312802 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-b35deaa6-c3b8-4b64-b92c-49976111540d req-c7c15901-8a6a-46cd-bf51-8cf87a92835d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0330d15d-bc30-4220-96a1-c42f83bf0648", "tag": "587f23cd-c3b2-4725-85e8-d50096d731dd"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:05.322455 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-b35deaa6-c3b8-4b64-b92c-49976111540d req-c7c15901-8a6a-46cd-bf51-8cf87a92835d service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:05.323245 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-b35deaa6-c3b8-4b64-b92c-49976111540d req-c7c15901-8a6a-46cd-bf51-8cf87a92835d service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:05.337596 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-b35deaa6-c3b8-4b64-b92c-49976111540d req-c7c15901-8a6a-46cd-bf51-8cf87a92835d service nova] Creating event network-changed:587f23cd-c3b2-4725-85e8-d50096d731dd for instance 0330d15d-bc30-4220-96a1-c42f83bf0648 on hv-cinder-84130 May 17 18:27:05.343571 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-b35deaa6-c3b8-4b64-b92c-49976111540d req-c7c15901-8a6a-46cd-bf51-8cf87a92835d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035631 May 17 18:27:05.344508 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 580/1176] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:27:05.363140 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-792d2cd6-7759-4980-aacf-ed80a10bf1c0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:05.373247 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-792d2cd6-7759-4980-aacf-ed80a10bf1c0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.201106 May 17 18:27:05.374958 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 597/1177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:05 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:06.392260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-78e7ac8e-104f-4f57-9d5c-1b6670b1d4e0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:06.393110 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-78e7ac8e-104f-4f57-9d5c-1b6670b1d4e0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:06.399542 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-78e7ac8e-104f-4f57-9d5c-1b6670b1d4e0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:06.400000 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-78e7ac8e-104f-4f57-9d5c-1b6670b1d4e0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:06.400780 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-78e7ac8e-104f-4f57-9d5c-1b6670b1d4e0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:06.401227 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-78e7ac8e-104f-4f57-9d5c-1b6670b1d4e0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:06.540922 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-78e7ac8e-104f-4f57-9d5c-1b6670b1d4e0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:06.549135 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-78e7ac8e-104f-4f57-9d5c-1b6670b1d4e0 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.161796 May 17 18:27:06.549720 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 581/1178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:06 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:07.565759 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e015f59c-eecd-436b-8c25-95d494af0e7a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:07.566336 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e015f59c-eecd-436b-8c25-95d494af0e7a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:07.573128 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e015f59c-eecd-436b-8c25-95d494af0e7a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:07.573566 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e015f59c-eecd-436b-8c25-95d494af0e7a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:07.575053 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e015f59c-eecd-436b-8c25-95d494af0e7a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:07.575492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e015f59c-eecd-436b-8c25-95d494af0e7a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:07.704193 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e015f59c-eecd-436b-8c25-95d494af0e7a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:07.711453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e015f59c-eecd-436b-8c25-95d494af0e7a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.149668 May 17 18:27:07.712016 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 598/1179] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:07 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:08.728166 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-f0b6cd74-1f33-4eb6-907d-a6b14e2fba0e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:08.728774 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-f0b6cd74-1f33-4eb6-907d-a6b14e2fba0e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:08.735720 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0b6cd74-1f33-4eb6-907d-a6b14e2fba0e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:08.736166 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0b6cd74-1f33-4eb6-907d-a6b14e2fba0e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:08.736957 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0b6cd74-1f33-4eb6-907d-a6b14e2fba0e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:08.737392 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-f0b6cd74-1f33-4eb6-907d-a6b14e2fba0e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:08.866501 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-f0b6cd74-1f33-4eb6-907d-a6b14e2fba0e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:08.874472 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-f0b6cd74-1f33-4eb6-907d-a6b14e2fba0e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.150161 May 17 18:27:08.875057 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 582/1180] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:08 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:09.893235 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e4404cf5-37e3-458f-9c72-05fc505fd84e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:09.893854 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e4404cf5-37e3-458f-9c72-05fc505fd84e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:09.900187 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e4404cf5-37e3-458f-9c72-05fc505fd84e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:09.900642 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e4404cf5-37e3-458f-9c72-05fc505fd84e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:09.901416 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e4404cf5-37e3-458f-9c72-05fc505fd84e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:09.901856 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e4404cf5-37e3-458f-9c72-05fc505fd84e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:10.034882 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e4404cf5-37e3-458f-9c72-05fc505fd84e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:10.042145 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e4404cf5-37e3-458f-9c72-05fc505fd84e tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.152941 May 17 18:27:10.042729 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 599/1181] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:09 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:11.058833 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e10179b5-cfbc-4366-bd0e-aa0aad9ec187 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:11.059876 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e10179b5-cfbc-4366-bd0e-aa0aad9ec187 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:11.065870 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e10179b5-cfbc-4366-bd0e-aa0aad9ec187 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:11.066323 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e10179b5-cfbc-4366-bd0e-aa0aad9ec187 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:11.067121 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e10179b5-cfbc-4366-bd0e-aa0aad9ec187 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:11.067560 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e10179b5-cfbc-4366-bd0e-aa0aad9ec187 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:11.211844 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e10179b5-cfbc-4366-bd0e-aa0aad9ec187 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:11.220159 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e10179b5-cfbc-4366-bd0e-aa0aad9ec187 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.165223 May 17 18:27:11.220733 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 583/1182] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:11 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:12.237117 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-ee59876d-e0b9-4a12-86f9-fce0a075a347 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:12.237734 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-ee59876d-e0b9-4a12-86f9-fce0a075a347 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:12.244246 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee59876d-e0b9-4a12-86f9-fce0a075a347 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:12.244709 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee59876d-e0b9-4a12-86f9-fce0a075a347 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:12.245484 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee59876d-e0b9-4a12-86f9-fce0a075a347 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:12.245926 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-ee59876d-e0b9-4a12-86f9-fce0a075a347 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:12.384627 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-ee59876d-e0b9-4a12-86f9-fce0a075a347 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:12.392161 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-ee59876d-e0b9-4a12-86f9-fce0a075a347 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.158949 May 17 18:27:12.392725 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 600/1183] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:12 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:13.408824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a55af5db-77dc-4e80-8d91-335089fc95d8 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:13.409424 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a55af5db-77dc-4e80-8d91-335089fc95d8 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:13.415824 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a55af5db-77dc-4e80-8d91-335089fc95d8 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:13.416275 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a55af5db-77dc-4e80-8d91-335089fc95d8 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:13.417038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a55af5db-77dc-4e80-8d91-335089fc95d8 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:13.417511 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a55af5db-77dc-4e80-8d91-335089fc95d8 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:13.547720 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-a55af5db-77dc-4e80-8d91-335089fc95d8 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:13.555062 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a55af5db-77dc-4e80-8d91-335089fc95d8 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.150110 May 17 18:27:13.555621 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 584/1184] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:13 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:14.572122 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-960b1af3-231b-4c2e-9b81-a7c337c486bc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:14.572814 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-960b1af3-231b-4c2e-9b81-a7c337c486bc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:14.579937 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-960b1af3-231b-4c2e-9b81-a7c337c486bc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:14.580395 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-960b1af3-231b-4c2e-9b81-a7c337c486bc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:14.581176 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-960b1af3-231b-4c2e-9b81-a7c337c486bc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:14.581625 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-960b1af3-231b-4c2e-9b81-a7c337c486bc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:14.712664 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-960b1af3-231b-4c2e-9b81-a7c337c486bc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:14.720639 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-960b1af3-231b-4c2e-9b81-a7c337c486bc tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.152718 May 17 18:27:14.721241 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 601/1185] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:14 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:15.738486 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-eba838e1-5d3a-40a0-9a87-c4a16246eda1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:15.739295 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-eba838e1-5d3a-40a0-9a87-c4a16246eda1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:15.746164 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eba838e1-5d3a-40a0-9a87-c4a16246eda1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:15.746641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eba838e1-5d3a-40a0-9a87-c4a16246eda1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:15.747570 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eba838e1-5d3a-40a0-9a87-c4a16246eda1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:15.748005 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-eba838e1-5d3a-40a0-9a87-c4a16246eda1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:15.883624 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-eba838e1-5d3a-40a0-9a87-c4a16246eda1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:15.893292 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-eba838e1-5d3a-40a0-9a87-c4a16246eda1 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.159608 May 17 18:27:15.894634 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 585/1186] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:15 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:16.252949 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-359d0871-4d6a-44f1-9e70-3e2653691db2 req-250ed019-9622-41f3-9eab-5a0e81cf8983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0330d15d-bc30-4220-96a1-c42f83bf0648", "name": "network-vif-plugged", "status": "completed", "tag": "587f23cd-c3b2-4725-85e8-d50096d731dd"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:16.262175 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-359d0871-4d6a-44f1-9e70-3e2653691db2 req-250ed019-9622-41f3-9eab-5a0e81cf8983 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:16.262828 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-359d0871-4d6a-44f1-9e70-3e2653691db2 req-250ed019-9622-41f3-9eab-5a0e81cf8983 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:16.278774 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-359d0871-4d6a-44f1-9e70-3e2653691db2 req-250ed019-9622-41f3-9eab-5a0e81cf8983 service nova] Creating event network-vif-plugged:587f23cd-c3b2-4725-85e8-d50096d731dd for instance 0330d15d-bc30-4220-96a1-c42f83bf0648 on hv-cinder-84130 May 17 18:27:16.284564 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-359d0871-4d6a-44f1-9e70-3e2653691db2 req-250ed019-9622-41f3-9eab-5a0e81cf8983 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035862 May 17 18:27:16.285373 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 602/1187] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:16.910784 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-e3a21b7c-fce6-4526-973d-b4be0f444886 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:16.911328 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-e3a21b7c-fce6-4526-973d-b4be0f444886 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:16.917554 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e3a21b7c-fce6-4526-973d-b4be0f444886 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:16.918081 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e3a21b7c-fce6-4526-973d-b4be0f444886 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:16.919595 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e3a21b7c-fce6-4526-973d-b4be0f444886 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:16.920038 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-e3a21b7c-fce6-4526-973d-b4be0f444886 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:17.052887 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-e3a21b7c-fce6-4526-973d-b4be0f444886 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:17.060325 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-e3a21b7c-fce6-4526-973d-b4be0f444886 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1266 microversion: 2.1 time: 0.153528 May 17 18:27:17.060899 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 586/1188] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:16 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:18.078477 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e5996400-a7e5-4781-80fa-ea4300f4ccd3 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:18.079300 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e5996400-a7e5-4781-80fa-ea4300f4ccd3 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:18.086093 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5996400-a7e5-4781-80fa-ea4300f4ccd3 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:18.086566 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5996400-a7e5-4781-80fa-ea4300f4ccd3 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:18.087393 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5996400-a7e5-4781-80fa-ea4300f4ccd3 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:18.087874 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e5996400-a7e5-4781-80fa-ea4300f4ccd3 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:18.473379 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e5996400-a7e5-4781-80fa-ea4300f4ccd3 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:18.481529 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e5996400-a7e5-4781-80fa-ea4300f4ccd3 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1453 microversion: 2.1 time: 0.407269 May 17 18:27:18.482110 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 603/1189] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:18 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1453 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:18.499260 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-2f00d236-d1a2-4499-a46f-7f418f5ee7fa tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:18.499917 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-2f00d236-d1a2-4499-a46f-7f418f5ee7fa tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:18.506294 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2f00d236-d1a2-4499-a46f-7f418f5ee7fa tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:18.506799 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2f00d236-d1a2-4499-a46f-7f418f5ee7fa tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:18.507575 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2f00d236-d1a2-4499-a46f-7f418f5ee7fa tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:18.508019 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-2f00d236-d1a2-4499-a46f-7f418f5ee7fa tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:18.635263 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-2f00d236-d1a2-4499-a46f-7f418f5ee7fa tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:18.642806 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-2f00d236-d1a2-4499-a46f-7f418f5ee7fa tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1453 microversion: 2.1 time: 0.147969 May 17 18:27:18.643380 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 587/1190] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:27:18 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:20.260548 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-157ce043-a960-4aa3-b970-4036eab1b6d7 req-4e08f248-b7bb-4428-bb47-a336cb85a105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0330d15d-bc30-4220-96a1-c42f83bf0648", "tag": "587f23cd-c3b2-4725-85e8-d50096d731dd"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:20.269329 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-157ce043-a960-4aa3-b970-4036eab1b6d7 req-4e08f248-b7bb-4428-bb47-a336cb85a105 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:20.269772 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-157ce043-a960-4aa3-b970-4036eab1b6d7 req-4e08f248-b7bb-4428-bb47-a336cb85a105 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:20.281092 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-157ce043-a960-4aa3-b970-4036eab1b6d7 req-4e08f248-b7bb-4428-bb47-a336cb85a105 service nova] Creating event network-changed:587f23cd-c3b2-4725-85e8-d50096d731dd for instance 0330d15d-bc30-4220-96a1-c42f83bf0648 on hv-cinder-84130 May 17 18:27:20.286319 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-157ce043-a960-4aa3-b970-4036eab1b6d7 req-4e08f248-b7bb-4428-bb47-a336cb85a105 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029382 May 17 18:27:20.286928 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 604/1191] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:49.273721 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:27:49.274336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Tue May 17 18:27:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:28:08.065881 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:28:08.066453 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Tue May 17 18:28:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:28:48.875864 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-30e5466b-a286-437b-87e2-3cb4dcf58112 req-0048864b-65e8-4a87-8ebc-53971633f1fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0330d15d-bc30-4220-96a1-c42f83bf0648", "tag": "587f23cd-c3b2-4725-85e8-d50096d731dd"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:28:48.881650 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-a6c2c245-882d-4dd1-99f5-7b06a92fe770 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:48.882160 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a6c2c245-882d-4dd1-99f5-7b06a92fe770 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:48.889726 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6c2c245-882d-4dd1-99f5-7b06a92fe770 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:48.890184 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6c2c245-882d-4dd1-99f5-7b06a92fe770 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:48.891005 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6c2c245-882d-4dd1-99f5-7b06a92fe770 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:48.891452 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-a6c2c245-882d-4dd1-99f5-7b06a92fe770 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:48.902380 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-30e5466b-a286-437b-87e2-3cb4dcf58112 req-0048864b-65e8-4a87-8ebc-53971633f1fc service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:48.903063 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-30e5466b-a286-437b-87e2-3cb4dcf58112 req-0048864b-65e8-4a87-8ebc-53971633f1fc service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:48.916100 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-30e5466b-a286-437b-87e2-3cb4dcf58112 req-0048864b-65e8-4a87-8ebc-53971633f1fc service nova] Creating event network-changed:587f23cd-c3b2-4725-85e8-d50096d731dd for instance 0330d15d-bc30-4220-96a1-c42f83bf0648 on hv-cinder-84130 May 17 18:28:48.922071 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-30e5466b-a286-437b-87e2-3cb4dcf58112 req-0048864b-65e8-4a87-8ebc-53971633f1fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051132 May 17 18:28:48.925167 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 605/1192] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:28:48.925793 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-a6c2c245-882d-4dd1-99f5-7b06a92fe770 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Going to try to terminate instance {{(pid=117020) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:28:49.006659 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-a6c2c245-882d-4dd1-99f5-7b06a92fe770 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 204 len: 0 microversion: 2.1 time: 0.137983 May 17 18:28:49.007184 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 588/1193] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:28:48 2022] DELETE /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:28:49.015994 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7a1ba72a-c999-40ff-a150-d3be6360afdf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:49.016703 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7a1ba72a-c999-40ff-a150-d3be6360afdf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:49.023714 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7a1ba72a-c999-40ff-a150-d3be6360afdf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:49.024179 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7a1ba72a-c999-40ff-a150-d3be6360afdf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:49.024957 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7a1ba72a-c999-40ff-a150-d3be6360afdf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:49.025405 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7a1ba72a-c999-40ff-a150-d3be6360afdf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:49.294971 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7a1ba72a-c999-40ff-a150-d3be6360afdf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:49.302553 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7a1ba72a-c999-40ff-a150-d3be6360afdf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1578 microversion: 2.1 time: 0.290782 May 17 18:28:49.303152 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 606/1194] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:28:49 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1578 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:28:50.320214 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-4368da4c-4774-4278-88ba-d77399f99e38 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:50.320942 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-4368da4c-4774-4278-88ba-d77399f99e38 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:50.327763 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4368da4c-4774-4278-88ba-d77399f99e38 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:50.328220 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4368da4c-4774-4278-88ba-d77399f99e38 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:50.328990 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4368da4c-4774-4278-88ba-d77399f99e38 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:50.329435 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-4368da4c-4774-4278-88ba-d77399f99e38 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:50.520201 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-4368da4c-4774-4278-88ba-d77399f99e38 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:50.527629 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-4368da4c-4774-4278-88ba-d77399f99e38 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1578 microversion: 2.1 time: 0.211694 May 17 18:28:50.528192 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 589/1195] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:28:50 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:28:51.544749 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e2b34f75-97a4-4680-bb3d-b7344e1ff186 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:51.545351 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e2b34f75-97a4-4680-bb3d-b7344e1ff186 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:51.551855 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2b34f75-97a4-4680-bb3d-b7344e1ff186 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:51.552300 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2b34f75-97a4-4680-bb3d-b7344e1ff186 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:51.553060 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2b34f75-97a4-4680-bb3d-b7344e1ff186 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:51.553492 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e2b34f75-97a4-4680-bb3d-b7344e1ff186 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:51.619379 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-e2b34f75-97a4-4680-bb3d-b7344e1ff186 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:51.628719 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e2b34f75-97a4-4680-bb3d-b7344e1ff186 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 200 len: 1391 microversion: 2.1 time: 0.085952 May 17 18:28:51.638205 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 607/1196] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:28:51 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 1391 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:28:51.693128 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [req-9ebdff0e-fd2e-4cf5-b553-1003a2c4e8fa req-371dd8df-450e-49d3-ba52-6cd9a46a0d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0330d15d-bc30-4220-96a1-c42f83bf0648", "name": "network-vif-deleted", "tag": "587f23cd-c3b2-4725-85e8-d50096d731dd"}]} {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:28:51.702951 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-9ebdff0e-fd2e-4cf5-b553-1003a2c4e8fa req-371dd8df-450e-49d3-ba52-6cd9a46a0d22 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:51.703468 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [req-9ebdff0e-fd2e-4cf5-b553-1003a2c4e8fa req-371dd8df-450e-49d3-ba52-6cd9a46a0d22 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:51.716074 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.compute.server_external_events [req-9ebdff0e-fd2e-4cf5-b553-1003a2c4e8fa req-371dd8df-450e-49d3-ba52-6cd9a46a0d22 service nova] Creating event network-vif-deleted:587f23cd-c3b2-4725-85e8-d50096d731dd for instance 0330d15d-bc30-4220-96a1-c42f83bf0648 on hv-cinder-84130 May 17 18:28:51.721536 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [req-9ebdff0e-fd2e-4cf5-b553-1003a2c4e8fa req-371dd8df-450e-49d3-ba52-6cd9a46a0d22 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033255 May 17 18:28:51.722212 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 590/1197] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:28:52.645778 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-77c80371-7c8d-4f1f-bda5-2c0a0836ea9a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:52.646324 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-77c80371-7c8d-4f1f-bda5-2c0a0836ea9a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0330d15d-bc30-4220-96a1-c42f83bf0648] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:52.652698 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-77c80371-7c8d-4f1f-bda5-2c0a0836ea9a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:52.653156 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-77c80371-7c8d-4f1f-bda5-2c0a0836ea9a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:52.653931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-77c80371-7c8d-4f1f-bda5-2c0a0836ea9a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:52.654372 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-77c80371-7c8d-4f1f-bda5-2c0a0836ea9a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:52.668456 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-77c80371-7c8d-4f1f-bda5-2c0a0836ea9a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] HTTP exception thrown: Instance 0330d15d-bc30-4220-96a1-c42f83bf0648 could not be found. May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-77c80371-7c8d-4f1f-bda5-2c0a0836ea9a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Request method failure captured: May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 HTTP/1.1 May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-fljdy9APNz-tl1IHZXlUwd7-hd4CP6c-W6nLH1xaibi3NmU2RTsAmzeK8z_WMyqVKqEKwicu7FH2LGJpxEkIbCrjTOhS6DryC0628jsKBGRwqU4KqlMUySuaRWb57qdlD6sEd_MGs9l0AjIbpsiVoKpt5PdaXqEV0IvxlZFC64eYw May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: af75981c6f0c44168aa9123430944fd2 May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-TestVolumeBootPattern-519166492 May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:28:52.670094 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af75981c6f0c44168aa9123430944fd2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-TestVolumeBootPattern-519166492 May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: af75981c6f0c44168aa9123430944fd2 May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-TestVolumeBootPattern-519166492 May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-TestVolumeBootPattern-519166492-project May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 91d999e39c144d04ac8c6ca5a4660d24 May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-TestVolumeBootPattern-519166492-project May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 0330d15d-bc30-4220-96a1-c42f83bf0648 could not be found. May 17 18:28:52.671961 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '0330d15d-bc30-4220-96a1-c42f83bf0648'} May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0330d15d-bc30-4220-96a1-c42f83bf0648 could not be found. May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:28:52.672931 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0330d15d-bc30-4220-96a1-c42f83bf0648 could not be found. May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0330d15d-bc30-4220-96a1-c42f83bf0648 could not be found. May 17 18:28:52.674707 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:52.676237 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-77c80371-7c8d-4f1f-bda5-2c0a0836ea9a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Returning 404 to user: Instance 0330d15d-bc30-4220-96a1-c42f83bf0648 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:28:52.676237 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-77c80371-7c8d-4f1f-bda5-2c0a0836ea9a tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648" status: 404 len: 111 microversion: 2.1 time: 0.030244 May 17 18:28:52.676237 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 608/1198] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:28:52 2022] GET /compute/v2.1/servers/0330d15d-bc30-4220-96a1-c42f83bf0648 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:28:55.683999 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-ccc118b2-a659-4a13-baad-8af3c0b55d24 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:55.684577 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ccc118b2-a659-4a13-baad-8af3c0b55d24 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:55.685099 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-0fba8356-4d40-4ae3-8fbb-e64f26bc3383 req-a905a052-7832-4d27-b193-6701ab6b3973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0265396a-e033-4631-b339-ec6ccf7b7fe2", "tag": "21635e39-b9c3-4c64-becd-0e1f113b368c"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:28:55.692621 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ccc118b2-a659-4a13-baad-8af3c0b55d24 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:55.693071 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ccc118b2-a659-4a13-baad-8af3c0b55d24 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:55.693646 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-0fba8356-4d40-4ae3-8fbb-e64f26bc3383 req-a905a052-7832-4d27-b193-6701ab6b3973 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:55.693839 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ccc118b2-a659-4a13-baad-8af3c0b55d24 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:55.694097 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-0fba8356-4d40-4ae3-8fbb-e64f26bc3383 req-a905a052-7832-4d27-b193-6701ab6b3973 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:55.694290 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-ccc118b2-a659-4a13-baad-8af3c0b55d24 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:55.705756 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-0fba8356-4d40-4ae3-8fbb-e64f26bc3383 req-a905a052-7832-4d27-b193-6701ab6b3973 service nova] Creating event network-changed:21635e39-b9c3-4c64-becd-0e1f113b368c for instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 on hv-cinder-84130 May 17 18:28:55.711313 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-0fba8356-4d40-4ae3-8fbb-e64f26bc3383 req-a905a052-7832-4d27-b193-6701ab6b3973 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029650 May 17 18:28:55.711902 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 609/1199] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:28:55.721794 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-ccc118b2-a659-4a13-baad-8af3c0b55d24 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Going to try to terminate instance {{(pid=117020) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:28:55.819658 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-ccc118b2-a659-4a13-baad-8af3c0b55d24 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 204 len: 0 microversion: 2.1 time: 0.140071 May 17 18:28:55.823778 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 591/1200] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:28:55 2022] DELETE /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:28:55.829373 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-7abc0bb8-6c0e-4230-983d-b78677c5f9df tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:55.830528 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-7abc0bb8-6c0e-4230-983d-b78677c5f9df tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:55.836864 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7abc0bb8-6c0e-4230-983d-b78677c5f9df tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:55.837537 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7abc0bb8-6c0e-4230-983d-b78677c5f9df tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:55.838530 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7abc0bb8-6c0e-4230-983d-b78677c5f9df tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:55.839182 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-7abc0bb8-6c0e-4230-983d-b78677c5f9df tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:55.975924 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.policy [None req-7abc0bb8-6c0e-4230-983d-b78677c5f9df tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117021) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:55.983296 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-7abc0bb8-6c0e-4230-983d-b78677c5f9df tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1573 microversion: 2.1 time: 0.158096 May 17 18:28:55.983868 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 610/1201] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:28:55 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:28:57.000948 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-544d8180-97e5-4389-b2e8-68d370b27dc9 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:57.001682 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-544d8180-97e5-4389-b2e8-68d370b27dc9 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:57.008897 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-544d8180-97e5-4389-b2e8-68d370b27dc9 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:57.009354 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-544d8180-97e5-4389-b2e8-68d370b27dc9 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:57.010243 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-544d8180-97e5-4389-b2e8-68d370b27dc9 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:57.010714 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-544d8180-97e5-4389-b2e8-68d370b27dc9 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:57.147095 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-544d8180-97e5-4389-b2e8-68d370b27dc9 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:57.155021 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-544d8180-97e5-4389-b2e8-68d370b27dc9 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1573 microversion: 2.1 time: 0.158339 May 17 18:28:57.155587 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 592/1202] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:28:56 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:28:58.036723 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [req-e716c0dc-3c94-4b67-8ff7-3e0daa49a1ad req-6e81f1ba-5ccb-404d-a397-02ead9d9aa89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0265396a-e033-4631-b339-ec6ccf7b7fe2", "name": "network-vif-deleted", "tag": "21635e39-b9c3-4c64-becd-0e1f113b368c"}]} {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:28:58.046915 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-e716c0dc-3c94-4b67-8ff7-3e0daa49a1ad req-6e81f1ba-5ccb-404d-a397-02ead9d9aa89 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:58.047483 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [req-e716c0dc-3c94-4b67-8ff7-3e0daa49a1ad req-6e81f1ba-5ccb-404d-a397-02ead9d9aa89 service nova] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:58.060136 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.compute.server_external_events [req-e716c0dc-3c94-4b67-8ff7-3e0daa49a1ad req-6e81f1ba-5ccb-404d-a397-02ead9d9aa89 service nova] Creating event network-vif-deleted:21635e39-b9c3-4c64-becd-0e1f113b368c for instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 on hv-cinder-84130 May 17 18:28:58.066063 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [req-e716c0dc-3c94-4b67-8ff7-3e0daa49a1ad req-6e81f1ba-5ccb-404d-a397-02ead9d9aa89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 May 17 18:28:58.066687 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 611/1203] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 17 18:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:28:58.172099 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-661eef05-e0e4-4018-bb78-658d82631fbf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:58.172721 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-661eef05-e0e4-4018-bb78-658d82631fbf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:58.179395 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-661eef05-e0e4-4018-bb78-658d82631fbf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:58.179867 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-661eef05-e0e4-4018-bb78-658d82631fbf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:58.180631 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-661eef05-e0e4-4018-bb78-658d82631fbf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:58.181078 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-661eef05-e0e4-4018-bb78-658d82631fbf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:58.243131 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.policy [None req-661eef05-e0e4-4018-bb78-658d82631fbf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d999e39c144d04ac8c6ca5a4660d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75981c6f0c44168aa9123430944fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117020) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:58.250641 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-661eef05-e0e4-4018-bb78-658d82631fbf tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 200 len: 1222 microversion: 2.1 time: 0.082311 May 17 18:28:58.251322 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 593/1204] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:28:58 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:28:59.270614 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5f030add-5b3b-414c-a2c6-b1ac82b09b45 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:59.271320 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-5f030add-5b3b-414c-a2c6-b1ac82b09b45 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: 0265396a-e033-4631-b339-ec6ccf7b7fe2] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:59.277457 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f030add-5b3b-414c-a2c6-b1ac82b09b45 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:59.277905 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f030add-5b3b-414c-a2c6-b1ac82b09b45 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:59.278699 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f030add-5b3b-414c-a2c6-b1ac82b09b45 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:59.279143 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-5f030add-5b3b-414c-a2c6-b1ac82b09b45 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:59.292689 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-5f030add-5b3b-414c-a2c6-b1ac82b09b45 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] HTTP exception thrown: Instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 could not be found. May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5f030add-5b3b-414c-a2c6-b1ac82b09b45 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Request method failure captured: May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 HTTP/1.1 May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-fljdy9APNz-tl1IHZXlUwd7-hd4CP6c-W6nLH1xaibi3NmU2RTsAmzeK8z_WMyqVKqEKwicu7FH2LGJpxEkIbCrjTOhS6DryC0628jsKBGRwqU4KqlMUySuaRWb57qdlD6sEd_MGs9l0AjIbpsiVoKpt5PdaXqEV0IvxlZFC64eYw May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: af75981c6f0c44168aa9123430944fd2 May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-TestVolumeBootPattern-519166492 May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:28:59.294290 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af75981c6f0c44168aa9123430944fd2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-TestVolumeBootPattern-519166492 May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: af75981c6f0c44168aa9123430944fd2 May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-TestVolumeBootPattern-519166492 May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-TestVolumeBootPattern-519166492-project May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 91d999e39c144d04ac8c6ca5a4660d24 May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-TestVolumeBootPattern-519166492-project May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 could not be found. May 17 18:28:59.295845 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': '0265396a-e033-4631-b339-ec6ccf7b7fe2'} May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 could not be found. May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:28:59.296731 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 could not be found. May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 could not be found. May 17 18:28:59.298440 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:59.300225 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-5f030add-5b3b-414c-a2c6-b1ac82b09b45 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Returning 404 to user: Instance 0265396a-e033-4631-b339-ec6ccf7b7fe2 could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:28:59.300225 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-5f030add-5b3b-414c-a2c6-b1ac82b09b45 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2" status: 404 len: 111 microversion: 2.1 time: 0.030357 May 17 18:28:59.300225 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 612/1205] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:28:59 2022] GET /compute/v2.1/servers/0265396a-e033-4631-b339-ec6ccf7b7fe2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:28:59.719344 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0226c999-b231-44cb-ab2d-3f3cffe16b33 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:59.719891 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.compute.api [None req-0226c999-b231-44cb-ab2d-3f3cffe16b33 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117020) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:59.726326 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0226c999-b231-44cb-ab2d-3f3cffe16b33 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:59.726817 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0226c999-b231-44cb-ab2d-3f3cffe16b33 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:59.727581 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0226c999-b231-44cb-ab2d-3f3cffe16b33 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:59.728017 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG oslo_concurrency.lockutils [None req-0226c999-b231-44cb-ab2d-3f3cffe16b33 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:59.743570 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.wsgi [None req-0226c999-b231-44cb-ab2d-3f3cffe16b33 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] HTTP exception thrown: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0226c999-b231-44cb-ab2d-3f3cffe16b33 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Request method failure captured: May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: request: DELETE /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac HTTP/1.1 May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept: application/json May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Accept-Encoding: identity May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Connection: close May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Length: 0 May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Content-Type: application/json May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Host: 10.222.0.25 May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Openstack-System-Scope: None May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: User-Agent: python-urllib3/1.26.9 May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Auth-Token: gAAAAABig-fljdy9APNz-tl1IHZXlUwd7-hd4CP6c-W6nLH1xaibi3NmU2RTsAmzeK8z_WMyqVKqEKwicu7FH2LGJpxEkIbCrjTOhS6DryC0628jsKBGRwqU4KqlMUySuaRWb57qdlD6sEd_MGs9l0AjIbpsiVoKpt5PdaXqEV0IvxlZFC64eYw May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Id: None May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Domain-Name: None May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Identity-Status: Confirmed May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Is-Admin-Project: True May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Id: default May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Domain-Name: Default May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Id: af75981c6f0c44168aa9123430944fd2 May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Project-Name: tempest-TestVolumeBootPattern-519166492 May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Role: reader,member May 17 18:28:59.745219 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Roles: reader,member May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af75981c6f0c44168aa9123430944fd2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant: tempest-TestVolumeBootPattern-519166492 May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Id: af75981c6f0c44168aa9123430944fd2 May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-Tenant-Name: tempest-TestVolumeBootPattern-519166492 May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User: tempest-TestVolumeBootPattern-519166492-project May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Id: default May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Domain-Name: Default May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Id: 91d999e39c144d04ac8c6ca5a4660d24 May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: X-User-Name: tempest-TestVolumeBootPattern-519166492-project May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: method: > May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: exception: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:28:59.746903 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: action_args: {'id': 'd81a563a-5441-4226-b0af-8e83d90e64ac'} May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:28:59.749336 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:28:59.750938 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: ERROR nova.api.openstack.wsgi May 17 18:28:59.753205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-0226c999-b231-44cb-ab2d-3f3cffe16b33 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Returning 404 to user: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. {{(pid=117020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:28:59.753205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-0226c999-b231-44cb-ab2d-3f3cffe16b33 tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 404 len: 111 microversion: 2.1 time: 0.031150 May 17 18:28:59.753205 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 594/1206] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 17 18:28:59 2022] DELETE /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:28:59.755643 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e36fe531-8108-4236-9488-b524edd5878c tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '>' {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:59.756257 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.compute.api [None req-e36fe531-8108-4236-9488-b524edd5878c tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] [instance: d81a563a-5441-4226-b0af-8e83d90e64ac] Fetching instance by UUID {{(pid=117021) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:59.762181 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e36fe531-8108-4236-9488-b524edd5878c tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:59.762728 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e36fe531-8108-4236-9488-b524edd5878c tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:59.763498 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e36fe531-8108-4236-9488-b524edd5878c tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:59.763935 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG oslo_concurrency.lockutils [None req-e36fe531-8108-4236-9488-b524edd5878c tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Lock "f72245b9-2fb6-4786-862f-c5dd2343c27b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:59.778005 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.wsgi [None req-e36fe531-8108-4236-9488-b524edd5878c tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] HTTP exception thrown: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e36fe531-8108-4236-9488-b524edd5878c tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Request method failure captured: May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: request: GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac HTTP/1.1 May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept: application/json May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Accept-Encoding: identity May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Connection: close May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Length: 0 May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Content-Type: application/json May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Host: 10.222.0.25 May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Openstack-System-Scope: None May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: User-Agent: python-urllib3/1.26.9 May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Auth-Token: gAAAAABig-fljdy9APNz-tl1IHZXlUwd7-hd4CP6c-W6nLH1xaibi3NmU2RTsAmzeK8z_WMyqVKqEKwicu7FH2LGJpxEkIbCrjTOhS6DryC0628jsKBGRwqU4KqlMUySuaRWb57qdlD6sEd_MGs9l0AjIbpsiVoKpt5PdaXqEV0IvxlZFC64eYw May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Id: None May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Domain-Name: None May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Identity-Status: Confirmed May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Is-Admin-Project: True May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Id: default May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Domain-Name: Default May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Id: af75981c6f0c44168aa9123430944fd2 May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Project-Name: tempest-TestVolumeBootPattern-519166492 May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Role: reader,member May 17 18:28:59.779547 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Roles: reader,member May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af75981c6f0c44168aa9123430944fd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af75981c6f0c44168aa9123430944fd2", "adminURL": "http://10.222.0.25:8080"}]}] May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant: tempest-TestVolumeBootPattern-519166492 May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Id: af75981c6f0c44168aa9123430944fd2 May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-Tenant-Name: tempest-TestVolumeBootPattern-519166492 May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User: tempest-TestVolumeBootPattern-519166492-project May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Id: default May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Domain-Name: Default May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Id: 91d999e39c144d04ac8c6ca5a4660d24 May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: X-User-Name: tempest-TestVolumeBootPattern-519166492-project May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: method: > May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: exception: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:28:59.781287 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: action_args: {'id': 'd81a563a-5441-4226-b0af-8e83d90e64ac'} May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: {{(pid=117021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:28:59.782227 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. May 17 18:28:59.783940 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: ERROR nova.api.openstack.wsgi May 17 18:28:59.785594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: DEBUG nova.api.openstack.wsgi [None req-e36fe531-8108-4236-9488-b524edd5878c tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Returning 404 to user: Instance d81a563a-5441-4226-b0af-8e83d90e64ac could not be found. {{(pid=117021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:28:59.785594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO nova.api.openstack.requestlog [None req-e36fe531-8108-4236-9488-b524edd5878c tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac" status: 404 len: 111 microversion: 2.1 time: 0.029900 May 17 18:28:59.785594 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: [pid: 117021|app: 0|req: 613/1207] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 17 18:28:59 2022] GET /compute/v2.1/servers/d81a563a-5441-4226-b0af-8e83d90e64ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 18:29:01.062216 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: DEBUG nova.api.openstack.wsgi [None req-8d61dd42-b030-4ece-8d28-329dd951865f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] Calling method '.version_select at 0x7f74abdd85e0>' {{(pid=117020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:01.084489 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO nova.api.openstack.requestlog [None req-8d61dd42-b030-4ece-8d28-329dd951865f tempest-TestVolumeBootPattern-519166492 tempest-TestVolumeBootPattern-519166492-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-718503433" status: 202 len: 0 microversion: 2.1 time: 0.026045 May 17 18:29:01.085064 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: [pid: 117020|app: 0|req: 595/1208] 10.222.0.25 () {58 vars in 1259 bytes} [Tue May 17 18:29:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-718503433 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:29:28.080152 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:29:28.080973 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Tue May 17 18:29:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:31:12.141639 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:31:12.142233 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Tue May 17 18:31:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:31:24.051767 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:31:24.052379 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Tue May 17 18:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:31:28.075782 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:31:28.076423 dv-cinder-841302-3-iscsi devstack@n-api.service[117021]: Tue May 17 18:31:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:31:37.487760 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:31:37.488283 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Tue May 17 18:31:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:32:48.088738 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:32:48.089574 dv-cinder-841302-3-iscsi devstack@n-api.service[117020]: Tue May 17 18:32:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!